-- Logs begin at Fri 2022-07-01 18:45:03 UTC, end at Fri 2022-07-01 20:09:51 UTC. -- Jul 01 19:44:11.912671 dv-cinder-844601-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 19:44:11 2022] *** Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: nodename: dv-cinder-844601-7-iscsi Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: machine: x86_64 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: clock source: unix Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: pcre jit disabled Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: detected number of CPU cores: 4 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: current working directory: / Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: detected binary path: /usr/bin/uwsgi-core Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: your processes number limit is 47680 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: your memory page size is 4096 bytes Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: detected max file descriptor number: 2048 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: lock engine: pthread robust mutexes Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: thunder lock: enabled Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 19:44:11.924942 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 19:44:11.966752 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: Python main interpreter initialized at 0x558d2959c9c0 Jul 01 19:44:11.966752 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: python threads support enabled Jul 01 19:44:11.966752 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: your server socket listen backlog is limited to 100 connections Jul 01 19:44:11.966752 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: your mercy for graceful operations on workers is 90 seconds Jul 01 19:44:11.967095 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 19:44:11.967171 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: *** Operational MODE: preforking *** Jul 01 19:44:11.967406 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: *** uWSGI is running in multiple interpreter mode *** Jul 01 19:44:11.967406 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: spawned uWSGI master process (pid: 109761) Jul 01 19:44:11.967582 dv-cinder-844601-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 19:44:11.969410 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: spawned uWSGI worker 1 (pid: 109762, cores: 1) Jul 01 19:44:11.969410 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: spawned uWSGI worker 2 (pid: 109763, cores: 1) Jul 01 19:44:11.969410 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 19:44:12.631208 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:44:12.635256 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:44:13.767274 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:44:13.767274 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: from cryptography.utils import int_from_bytes Jul 01 19:44:13.767863 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:44:13.767863 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: from cryptography.utils import int_from_bytes Jul 01 19:44:13.769273 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:44:13.769273 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: from cryptography.utils import int_from_bytes Jul 01 19:44:13.769719 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:44:13.769719 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: from cryptography.utils import int_from_bytes Jul 01 19:44:16.260097 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:44:16.260657 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:44:16.260858 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:44:16.261209 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:44:16.261464 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:44:16.261873 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.262197 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.262517 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.262834 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.263168 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.263475 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.263793 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.264111 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.264436 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.264695 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.264960 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:44:16.265331 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.265423 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:44:16.265510 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-7-iscsi {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.265642 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.265810 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:44:16.265949 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.266170 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:44:16.266264 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.266423 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:44:16.266562 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.266804 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.266892 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.267127 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.267271 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.267444 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.267570 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.267757 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.267949 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.268096 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269222 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269366 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269366 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269661 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269788 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269918 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.269918 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.270157 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.270277 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.270484 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271145 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271261 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271380 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-7-iscsi {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271501 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271630 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271764 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271764 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.271992 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272114 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272243 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272371 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-7-iscsi {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272499 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272627 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272748 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272876 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.272997 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.273188 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.273312 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.273618 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.273759 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.273935 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.274075 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.274245 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.274377 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.274567 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.274706 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.274888 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275013 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275193 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275317 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275519 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275659 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275836 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.275965 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.276139 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.276278 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.276456 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.276587 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.276758 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.276904 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.277064 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.277196 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-7-iscsi {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.277372 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.277504 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.277722 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.277862 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278029 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278154 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278331 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278456 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278591 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278746 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.278870 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.279053 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.279179 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.279373 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.279508 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.279704 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280098 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280275 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280403 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280525 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280656 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280825 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.280952 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.281144 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.281271 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.281452 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.281626 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.281785 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.281925 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.282093 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.282219 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.282401 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.282535 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.282706 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.282839 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283016 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283141 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283315 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283440 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283563 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283685 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283856 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.283991 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.284177 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.284302 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.284496 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.284629 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.284807 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.284941 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285067 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285196 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285319 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285503 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285676 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285819 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.285943 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.286066 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.286793 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.287147 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.287472 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.287590 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.287787 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.287913 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.288111 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.288237 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.288433 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.288559 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.288740 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.288874 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.289042 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.289168 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.289347 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.289478 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.289687 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.289817 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290002 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290142 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290306 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290430 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290552 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290673 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290842 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.290978 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.291145 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.291292 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.291461 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.291604 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.291766 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.291902 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292071 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292196 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292375 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292507 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292677 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292820 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.292977 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.293103 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.293280 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.293413 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.293614 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.293759 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.293912 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294050 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294218 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294344 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294521 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294648 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294829 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.294955 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295132 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295258 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295388 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295510 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295683 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295809 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.295984 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.296120 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.296300 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.296427 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.296604 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.296730 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.296906 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297032 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297241 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297378 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297509 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297660 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297806 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.297941 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.298110 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.298245 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.298414 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.298541 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.298718 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.298845 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299019 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299143 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299317 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299442 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299623 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299757 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.299924 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300056 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300222 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300355 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300525 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300659 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300830 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.300956 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.301130 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.301254 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.301433 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.301569 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.301785 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.301942 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.302101 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.302407 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.302580 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.302716 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.302908 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.303034 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.303216 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.303342 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.303522 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.303661 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.303842 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304006 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304131 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304265 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304439 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304575 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304754 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.304879 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305056 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305209 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305345 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305467 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305682 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305810 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.305980 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.306104 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.306285 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.306412 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.306600 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.306727 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.306903 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.307063 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.307200 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.307325 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.307491 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.307618 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.307792 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.307929 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.308091 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.308218 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.308394 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.308519 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.308692 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.308832 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.308991 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.309124 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.309288 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.309420 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.309618 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.309763 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.309936 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.310071 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.310239 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.310366 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.310544 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.310683 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.310846 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.310972 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.311162 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:44:16.311288 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.311494 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.311621 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.311815 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.311939 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.312131 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.312257 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.312454 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.312591 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.312769 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.312893 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.313085 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.313232 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.313402 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.313537 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.313734 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.313860 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314074 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314202 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314357 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314501 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314666 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314801 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.314975 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.315103 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.315283 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.315408 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.315593 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.315727 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.315906 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316033 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316232 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316366 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316540 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316664 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316850 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.316984 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.317160 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.317285 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.317488 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.317655 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.317950 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.318261 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.318395 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.318549 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.318677 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.318886 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319197 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319324 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319509 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319823 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.319948 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.320138 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.320277 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.320450 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.320576 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.320760 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.320886 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321069 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321196 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321373 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321505 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321690 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321825 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.321993 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.322120 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.322303 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.322430 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.322607 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.322746 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.322922 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323047 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323233 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323370 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323536 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323675 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323843 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.323969 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.324153 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.324280 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.324461 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.324603 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.324772 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.324906 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.325083 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.325218 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.325389 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.325517 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.325719 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.325856 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326029 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326208 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326340 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326465 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326633 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326757 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.326939 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327066 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327241 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327373 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327544 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327679 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327845 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.327974 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.328147 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.328273 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.328447 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.328572 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.328758 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.328891 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.329071 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.329196 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.329372 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.329504 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.329704 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.329841 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330143 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330318 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330445 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330626 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330758 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.330933 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331058 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331238 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331547 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331683 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331859 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.331985 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.332162 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.332288 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.332481 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.332609 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.332789 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.332916 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.333661 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334009 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334156 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334280 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334522 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334657 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334833 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.334961 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.335139 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.335266 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.335444 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.335564 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.335749 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.335890 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336052 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336187 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336354 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336481 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336660 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336795 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.336969 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.337095 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.337272 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.337399 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.337575 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.337732 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.337904 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.338218 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.338474 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.338587 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.338712 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.338844 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.338966 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339089 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339211 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339333 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339461 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339595 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339718 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.339841 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340022 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340150 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340325 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340452 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340628 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340763 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.340930 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341069 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341235 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341362 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341537 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341690 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341864 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.341991 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.342167 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.342295 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.342472 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.342599 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.342772 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.342898 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343091 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343225 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343397 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343523 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343698 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343833 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.343998 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.344124 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.344298 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.344425 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.344634 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.344769 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.344934 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.345060 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.345266 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.345391 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.345615 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.345764 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.345919 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346045 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346232 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346357 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346539 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346673 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346845 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.346970 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.347151 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.347275 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.347456 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.347658 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.347784 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.347905 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.348057 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.348196 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.348374 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.348499 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.348788 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.349425 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.349635 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.349950 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.350093 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.350270 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.350397 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.350576 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.350704 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.350890 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351026 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351218 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351345 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351551 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351680 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351861 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.351996 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.352172 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.352298 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.352492 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.352619 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.352802 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.352930 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.353111 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.353238 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.353426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.353559 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.353759 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.353888 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354064 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354190 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354370 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354494 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354676 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354810 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.354981 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.355114 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.355292 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.355419 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.355597 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.355724 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.355908 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356033 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356212 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356350 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356517 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356645 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356820 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.356946 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.357128 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.357262 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.357428 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.357553 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.357770 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.357895 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358073 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358213 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358389 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358515 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358693 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358819 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.358999 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.359138 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.359318 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.359445 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.359622 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.359755 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.359926 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360063 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360230 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360356 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360532 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360658 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360842 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.360998 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.361148 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.361272 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.361464 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.361744 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.361875 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.362061 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.362152 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.362379 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.362467 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.362694 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.362795 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363000 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363097 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363307 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363401 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363615 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363712 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.363921 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.364014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.364229 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.364321 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.364580 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.364890 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.365142 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.365231 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.365464 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.365551 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.365822 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.365980 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366120 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366286 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366562 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366709 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366855 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.366992 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.367129 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.367297 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.367444 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.367616 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.367762 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.367909 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.368178 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.368432 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.368609 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.368772 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.368918 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369055 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369192 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369329 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369654 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369800 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.369944 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370082 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370218 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370381 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370519 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370657 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370801 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.370948 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371122 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371420 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371565 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371708 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371846 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.371982 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372118 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372277 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372417 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372553 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372697 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372840 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.372986 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.373136 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.373309 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.373462 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.373655 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.373802 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.373953 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.374100 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.374244 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.374389 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.374527 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.374663 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.374885 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375033 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375170 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375315 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375453 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375645 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375807 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.375976 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.376133 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.376272 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.376407 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.376568 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.376723 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.376863 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.377007 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.377146 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.377290 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.377489 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.377658 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378003 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378157 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378157 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378444 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378592 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378738 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.378876 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.379021 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.379166 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.379302 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.379447 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.379594 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.379731 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.380395 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.380562 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.380700 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.380844 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.381116 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.381263 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.381426 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.381572 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.381766 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.381922 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382072 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382210 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382357 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382495 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382642 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382788 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.382966 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383109 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383254 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383399 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383543 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383688 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383827 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.383963 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.384105 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.384243 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.384416 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.384580 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.384719 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.384863 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385008 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385146 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385283 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385428 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385566 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385742 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.385929 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386075 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386224 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386362 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386508 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386645 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386813 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.386966 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.387135 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.387280 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.387441 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.387585 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.387746 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.387891 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388042 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388188 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388335 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388480 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388617 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388752 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.388921 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.389067 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.389229 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.389375 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.389520 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.389728 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.389869 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390004 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390148 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390303 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390447 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390594 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390739 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.390877 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391025 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391163 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391298 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391443 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391616 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391762 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.391933 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392090 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392249 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392403 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392546 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392690 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392827 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.392962 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393107 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393246 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393389 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393526 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393692 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393842 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.393989 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.394137 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.394275 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.394411 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.394569 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.394716 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.394863 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.395000 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.395199 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.395338 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.395474 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.396193 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.396516 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.396808 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.397147 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.397317 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.397465 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.397641 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.397789 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.397928 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.398106 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.398260 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.398423 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.398584 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.398723 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.398860 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399008 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399153 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399322 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399476 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399621 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399759 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.399921 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.400075 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.400227 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.400373 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.400542 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.400688 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.400860 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401017 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401163 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401300 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401460 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401659 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401805 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.401943 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.402161 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.402301 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.402438 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.402574 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.402710 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.402865 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403024 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403162 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403299 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403435 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403578 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403723 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.403869 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.404015 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.404166 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.404303 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.404438 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.404583 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.404720 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.405138 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.405277 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.405421 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.405565 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.405745 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.405893 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406030 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406176 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406315 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406452 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406597 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406798 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.406955 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.407111 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.407250 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.407387 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.407540 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.407704 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.407849 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408016 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408168 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408325 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408471 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408608 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408751 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.408899 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.409036 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.409213 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.409360 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.409524 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.409698 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.409861 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410007 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410157 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410303 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410594 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410764 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.410920 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.411071 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.411290 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.411533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.411849 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.411994 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.412143 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.412282 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.412452 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.412598 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.412766 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.412911 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413063 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413223 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413368 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413505 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413689 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413831 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.413982 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.414145 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.414405 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.414635 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.414849 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.415169 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.415401 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.415623 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.415870 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416102 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416334 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416501 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416616 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416705 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416787 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416868 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.416947 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417034 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417106 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417172 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417237 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417312 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417381 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417463 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417778 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.417899 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418101 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418338 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418447 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418643 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418759 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.418952 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.419074 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.419265 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.419372 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.419575 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.419784 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420010 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420107 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420323 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420412 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420729 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.420938 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421025 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421249 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421345 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421560 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421686 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421894 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.421990 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.422209 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.422298 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.422515 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.422610 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.422865 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.423113 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.423212 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.423432 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.423744 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.423829 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424056 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424154 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424361 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424531 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424665 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424873 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.424960 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.425191 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.425279 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.425516 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.425698 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.425963 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.426052 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.426265 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.426376 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.426590 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.426690 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.426917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.427083 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.427532 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.427846 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.427942 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.428157 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.428253 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.428473 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.428560 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.428782 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.428880 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.429091 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.429262 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.429417 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.429602 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.429770 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.429905 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.430084 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.430230 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.430398 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.430553 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.430710 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.430879 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431015 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431187 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431320 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431501 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431644 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431811 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.431949 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.432134 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.432271 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.432458 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.432587 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.432772 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.432909 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.433087 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.433231 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.433393 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.433537 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.433745 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.433885 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.434070 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.434199 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.434383 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.434505 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.434705 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.434793 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.435101 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.435190 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.435428 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.435517 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.435734 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.435819 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436051 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436150 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436376 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436471 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436684 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436784 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.436986 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.437084 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.437296 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.437384 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.437651 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.437767 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.437925 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438028 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438249 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438338 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438554 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438649 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438863 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.438959 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.439169 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.439257 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.439473 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.439565 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.439776 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.439864 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440074 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440210 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440376 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440464 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440683 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440770 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.440980 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.441074 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.441283 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.441370 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.441597 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.441689 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.441928 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.442016 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.442232 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.442335 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.443094 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.443405 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.443572 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.443711 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.443905 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444006 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444221 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444309 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444526 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444638 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444834 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.444930 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.445177 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.445273 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.445482 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.445570 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.445825 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.445927 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.446157 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.446244 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.446486 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.446582 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.446799 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.446909 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.447122 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.447219 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.447439 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.447527 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.447750 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.447837 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448065 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448152 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448386 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448473 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448687 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448775 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.448991 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.449078 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.449299 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.449388 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.449618 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.449710 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.449922 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.450223 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.450359 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.450527 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.450698 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.450828 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.451102 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.451199 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.451414 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.451519 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.451733 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.451820 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452033 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452120 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452345 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452445 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452648 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452735 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.452951 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453037 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453252 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453349 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453552 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453671 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453887 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.453976 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.454199 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.454301 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.454526 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.454613 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.454839 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.454933 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.455158 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.455247 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.455483 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.455570 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.455788 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.455875 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.456102 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.456190 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.456412 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.456609 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.456723 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.456933 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.457032 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.457296 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.457387 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.457636 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.457740 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.457951 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.458042 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.459026 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.459390 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.459486 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.459714 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.460036 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.460322 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.460459 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.460658 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.461061 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.461207 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.461391 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.461538 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.461742 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.461876 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.462067 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.462210 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.462387 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.462477 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.462705 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.462799 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.463026 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.463123 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.463347 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.463436 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.463664 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.463752 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.464012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.464136 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.464282 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.464370 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.464609 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.464928 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.465024 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.465253 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.465604 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.465753 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.465921 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.466088 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.466217 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.466533 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.466627 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.466844 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.466960 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.467198 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.467308 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.467512 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.467605 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.467815 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.467907 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.468124 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.468224 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.468437 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.468528 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.468748 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.468840 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.469057 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.469151 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.469367 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.469709 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470021 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470231 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470333 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470560 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470648 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470881 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.470969 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.471197 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.471301 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.471521 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.471623 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.471835 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.471927 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.472146 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.472258 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.472452 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.472543 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.472761 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.472854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.473074 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.473291 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.473603 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.473718 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.474052 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.474499 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.474838 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.474934 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.475185 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.475285 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.475520 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.475620 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.475846 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.475937 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.476164 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.476256 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.476488 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.476593 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.476797 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.476888 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.477109 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.477201 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.477424 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.477525 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.477762 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.477854 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.478072 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.478164 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.478385 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.478478 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.478694 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.478785 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479003 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479311 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479404 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479624 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479848 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.479940 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.480270 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.480376 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.480525 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.480624 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.480833 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.480934 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.481140 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.481239 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.481454 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.481544 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.481788 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.481881 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.482097 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.482189 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.482406 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.482506 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.482710 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.482797 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483023 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483112 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483328 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483416 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483720 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.483940 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484035 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484249 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484337 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484553 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484647 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484857 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.484947 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.485167 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.485262 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.485473 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.485570 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.485844 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.485934 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.486149 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.486246 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.486453 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.486556 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.486758 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.486847 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487071 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487159 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487375 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487475 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487704 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487801 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.487985 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.488073 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.488289 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.488386 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.488601 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.488848 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.488936 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.489187 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.489283 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.489517 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.489783 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.489873 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.490140 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.490241 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.490442 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.490543 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.490770 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.490857 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.491079 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.491167 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.491388 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.491477 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.491686 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.491831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492000 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492096 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492309 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492413 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492619 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492718 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.492923 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493030 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493232 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493320 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493655 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493883 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.493986 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.494199 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.494416 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.494504 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.494752 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.494840 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.495074 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.495163 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.495396 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.495483 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.495706 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.495807 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496014 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496100 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496320 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496408 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496626 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496722 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.496948 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497036 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497256 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497343 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497566 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497690 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497894 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.497984 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.498205 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.498291 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.498511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.498613 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.498816 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.498903 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.499121 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.499215 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.499430 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.499561 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.499740 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.499856 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500043 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500158 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500350 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500465 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500656 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500773 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.500964 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.501079 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.501277 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.501394 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.501633 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.501753 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.501957 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.502091 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.502274 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.502396 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.502591 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.502789 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.502901 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503022 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503203 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503319 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503627 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503824 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.503949 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.504131 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.504246 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.504446 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.504561 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.504774 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.505388 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.505572 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.505795 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.505887 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.505968 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.506235 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.506324 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.506555 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.506644 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.506868 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.506957 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.507175 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.507264 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.507477 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.507564 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.507787 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.507884 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.508098 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.508196 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.508394 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.508481 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.508699 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.508795 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509003 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509090 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509312 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509399 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509636 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509750 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.509942 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510031 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510294 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510389 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510546 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510644 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510849 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.510945 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.511151 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.511246 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.511453 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.511549 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.511754 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.511841 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512057 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512185 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512355 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512443 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512655 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512742 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.512956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513044 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513255 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513342 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513655 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513883 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.513969 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.514188 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.514278 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.514496 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.514583 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.514797 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.514898 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.515101 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.515189 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.515403 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.515491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.515706 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.515801 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516008 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516092 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516310 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516397 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516615 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516713 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.516917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517004 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517219 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517313 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517521 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517672 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517881 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.517977 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.518144 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.518232 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.518464 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.518552 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.518793 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.518880 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.519102 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.519188 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.519410 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.519500 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.519720 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.519815 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.520040 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.520134 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.520344 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.520432 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.521260 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.521353 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.521603 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.521719 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.521930 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522062 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522238 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522329 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522546 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522648 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522861 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.522987 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.523169 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.523256 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.523479 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.523574 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.523791 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.523877 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.524101 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.524189 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.524414 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.524504 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.524739 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.524826 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.525049 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.525137 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.525352 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.525448 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.525699 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.525794 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526018 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526109 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526339 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526437 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526655 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526745 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.526967 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.527103 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.527293 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.527382 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.527600 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.527687 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.527909 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.528006 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.528150 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109763) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:44:16.528246 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.528516 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.528829 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.529145 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.529460 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.530072 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.530402 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.530712 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.531037 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.531362 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.531707 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.532020 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.532360 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.532685 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.533000 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.533312 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.533642 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:44:16.533887 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109762) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:44:16.684175 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO dbcounter [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Registered counter for database nova_api Jul 01 19:44:16.689892 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO dbcounter [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Registered counter for database nova_api Jul 01 19:44:16.704107 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_db.sqlalchemy.engines [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.709192 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_db.sqlalchemy.engines [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.710897 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writer thread running {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.715595 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writer thread running {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.767991 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.context [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc420076-a5c0-4107-825e-ec6145e40494(cell1) {{(pid=109763) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:44:16.772456 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.773526 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.context [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc420076-a5c0-4107-825e-ec6145e40494(cell1) {{(pid=109762) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:44:16.774060 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.774860 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.776806 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.777490 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_concurrency.lockutils [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.778865 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO dbcounter [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Registered counter for database nova_cell0 Jul 01 19:44:16.779153 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_concurrency.lockutils [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.780194 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_concurrency.lockutils [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:44:16.782179 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_concurrency.lockutils [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109762) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:44:16.784143 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO dbcounter [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Registered counter for database nova_cell0 Jul 01 19:44:16.784591 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO dbcounter [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Registered counter for database nova_cell1 Jul 01 19:44:16.790443 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO dbcounter [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Registered counter for database nova_cell1 Jul 01 19:44:16.792294 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_db.sqlalchemy.engines [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.794052 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_db.sqlalchemy.engines [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.797221 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_db.sqlalchemy.engines [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.798495 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writer thread running {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.800767 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_db.sqlalchemy.engines [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.803801 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writer thread running {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.936899 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writer thread running {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.944474 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writer thread running {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.947040 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO dbcounter [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Registered counter for database nova_cell0 Jul 01 19:44:16.953450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO dbcounter [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Registered counter for database nova_cell0 Jul 01 19:44:16.955944 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_db.sqlalchemy.engines [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109763) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.961148 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writer thread running {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:16.962425 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG oslo_db.sqlalchemy.engines [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109762) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:44:16.966809 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writer thread running {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:44:17.299647 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: WARNING keystonemiddleware.auth_token [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:44:17.305480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: WARNING keystonemiddleware.auth_token [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:44:17.307485 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: WARNING keystonemiddleware.auth_token [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:44:17.312720 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: WARNING keystonemiddleware.auth_token [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:44:17.656293 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: WARNING keystonemiddleware.auth_token [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:44:17.658077 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: WARNING keystonemiddleware.auth_token [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:44:17.662444 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: WARNING keystonemiddleware.auth_token [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:44:17.664019 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: WARNING keystonemiddleware.auth_token [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:44:17.667703 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d2959c9c0 pid: 109762 (default app) Jul 01 19:44:17.669273 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d2959c9c0 pid: 109763 (default app) Jul 01 19:44:17.669793 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:44:17.670996 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-534e0da9-e186-408a-8fa2-540f2992e894 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001773 Jul 01 19:44:17.671397 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Fri Jul 1 19:44:17 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:33.028959 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:33.030923 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002903 Jul 01 19:45:33.031636 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 1/2] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:33 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:33.043887 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writing DB stats nova_api:SELECT=3 {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:33.044883 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writing DB stats nova_cell0:SELECT=3 {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:33.046150 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writing DB stats nova_cell1:SELECT=3 {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:33.046974 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:33.485692 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-0cb7288a-a8ce-46b3-a978-a13d784dbe36 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:33.515456 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-0cb7288a-a8ce-46b3-a978-a13d784dbe36 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.476879 Jul 01 19:45:33.515991 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 1 19:45:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:35.628983 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:35.630072 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-a603ff32-7cb8-4a5b-a564-c2c401598cfa None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jul 01 19:45:35.630661 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 2/4] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:35.691524 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-5764b6a4-d9f8-4eb0-a958-2903e4aea5b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "id": "c1", "disk": 1, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:35.710690 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:45:35.710690 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: warnings.warn(msg) Jul 01 19:45:35.740164 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-5764b6a4-d9f8-4eb0-a958-2903e4aea5b3 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.103582 Jul 01 19:45:35.741080 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 3/5] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:45:35.755014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_api:SELECT=3 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:35.756203 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_cell0:SELECT=3 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:35.757725 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_cell1:SELECT=3 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:35.758783 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:45:35.964052 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-9bed1023-3b52-49b2-9c3a-5fd8ba7e9a5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:35.966472 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:45:35.966472 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: warnings.warn(msg) Jul 01 19:45:36.027015 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-9bed1023-3b52-49b2-9c3a-5fd8ba7e9a5e admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.277979 Jul 01 19:45:36.027521 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 3/6] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 1 19:45:35 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:38.150775 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-5764b6a4-d9f8-4eb0-a958-2903e4aea5b3 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:38.151885 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-5764b6a4-d9f8-4eb0-a958-2903e4aea5b3 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 01 19:45:38.153502 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 4/7] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:38.276979 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-48d2f01b-6f28-4fc6-9219-8f75b95954df admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "swap": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:38.295747 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:45:38.295747 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: warnings.warn(msg) Jul 01 19:45:38.315307 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-48d2f01b-6f28-4fc6-9219-8f75b95954df admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.154534 Jul 01 19:45:38.315888 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 4/8] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:45:38.327781 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-fc780f36-ff71-4491-aef7-d523d1a20c2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:38.329239 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:45:38.329239 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: warnings.warn(msg) Jul 01 19:45:38.361982 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-fc780f36-ff71-4491-aef7-d523d1a20c2b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037364 Jul 01 19:45:38.362550 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 5/9] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 1 19:45:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:40.464037 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-48d2f01b-6f28-4fc6-9219-8f75b95954df admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:40.465620 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-48d2f01b-6f28-4fc6-9219-8f75b95954df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Jul 01 19:45:40.466258 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 5/10] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:40.531680 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-2cf9d659-b200-4878-be9d-98bc1d2c5204 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:40.552708 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-2cf9d659-b200-4878-be9d-98bc1d2c5204 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080598 Jul 01 19:45:40.561594 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 6/11] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:45:40.569289 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-aaf1cbbe-6934-443d-8ead-62788809c946 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:40.599335 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-aaf1cbbe-6934-443d-8ead-62788809c946 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036953 Jul 01 19:45:40.600222 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 6/12] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 1 19:45:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:42.717083 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-2cf9d659-b200-4878-be9d-98bc1d2c5204 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:42.718813 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-2cf9d659-b200-4878-be9d-98bc1d2c5204 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002163 Jul 01 19:45:42.719423 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 7/13] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:42.779208 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-c3ac7db2-5460-471b-8ca2-f9ab5df33b8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "name": "ds2G", "disk": 10, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:42.796738 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-c3ac7db2-5460-471b-8ca2-f9ab5df33b8f admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071295 Jul 01 19:45:42.797195 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 7/14] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:42.809167 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-4a4bf226-1eab-4c02-a7fb-7ecd8c96531d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:42.831821 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-4a4bf226-1eab-4c02-a7fb-7ecd8c96531d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026309 Jul 01 19:45:42.832381 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 8/15] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 1 19:45:42 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:44.970336 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-c3ac7db2-5460-471b-8ca2-f9ab5df33b8f admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:44.971802 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-c3ac7db2-5460-471b-8ca2-f9ab5df33b8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002035 Jul 01 19:45:44.972234 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 8/16] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:45.031248 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-bac370a1-37f8-40cb-b5bc-3049e4759d13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20, "ram": 4096, "vcpus": 4, "name": "ds4G", "swap": 0}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:45.050897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-bac370a1-37f8-40cb-b5bc-3049e4759d13 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072700 Jul 01 19:45:45.051454 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 9/17] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:45.063332 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-ab4992a5-ba60-4be0-8f1d-d82d7f2aa6b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:45.085955 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-ab4992a5-ba60-4be0-8f1d-d82d7f2aa6b2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026447 Jul 01 19:45:45.086603 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 9/18] 10.222.0.66 () {64 vars in 1335 bytes} [Fri Jul 1 19:45:45 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:45:47.178450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-bac370a1-37f8-40cb-b5bc-3049e4759d13 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:47.179465 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-bac370a1-37f8-40cb-b5bc-3049e4759d13 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 01 19:45:47.179881 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 10/19] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:47.241818 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-1f5929d0-14ce-43cd-9bf4-def24e02051d admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:47.266214 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-1f5929d0-14ce-43cd-9bf4-def24e02051d admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080026 Jul 01 19:45:47.266773 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 10/20] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 1 19:45:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:45:49.404194 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-bac370a1-37f8-40cb-b5bc-3049e4759d13 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:49.405186 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-bac370a1-37f8-40cb-b5bc-3049e4759d13 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jul 01 19:45:49.405548 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 11/21] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:49.469571 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-070a10ad-909b-4b08-8e56-8c6f95fcb454 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "1", "disk": 1, "swap": 0}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:49.492304 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-070a10ad-909b-4b08-8e56-8c6f95fcb454 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079928 Jul 01 19:45:49.492859 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 11/22] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:49 2022] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:49.505665 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-ce707041-51fd-4ac2-82f6-53bde21966cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:49.530281 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-ce707041-51fd-4ac2-82f6-53bde21966cf admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029138 Jul 01 19:45:49.530788 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 12/23] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 1 19:45:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:51.687814 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-070a10ad-909b-4b08-8e56-8c6f95fcb454 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:51.688822 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-070a10ad-909b-4b08-8e56-8c6f95fcb454 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jul 01 19:45:51.689786 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 12/24] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:51.750305 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-a953fafd-a531-418d-975a-afcd13a1d554 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "ram": 2048, "id": "2", "disk": 20}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:51.769502 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-a953fafd-a531-418d-975a-afcd13a1d554 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073713 Jul 01 19:45:51.770332 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 13/25] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:51.782211 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-5829676d-f951-468f-ba44-ed2b4128fb24 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:51.805185 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-5829676d-f951-468f-ba44-ed2b4128fb24 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026971 Jul 01 19:45:51.805816 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 13/26] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 1 19:45:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:53.951730 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-a953fafd-a531-418d-975a-afcd13a1d554 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:53.952731 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-a953fafd-a531-418d-975a-afcd13a1d554 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 01 19:45:53.953133 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 14/27] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:54.032231 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-842364d7-cca8-4f73-9d8d-1ba5c3be8453 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:54.052893 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-842364d7-cca8-4f73-9d8d-1ba5c3be8453 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.093528 Jul 01 19:45:54.053390 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 14/28] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:54.067334 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-04a425c5-efa6-4e45-abbf-cf0b44d15ea2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:54.093953 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-04a425c5-efa6-4e45-abbf-cf0b44d15ea2 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031713 Jul 01 19:45:54.094704 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 15/29] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 1 19:45:54 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:56.228928 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-842364d7-cca8-4f73-9d8d-1ba5c3be8453 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:56.229991 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-842364d7-cca8-4f73-9d8d-1ba5c3be8453 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 01 19:45:56.230564 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 15/30] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:56.296631 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-b46c2431-5d7f-4fad-a289-1185b521398a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:56.315396 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-b46c2431-5d7f-4fad-a289-1185b521398a admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079323 Jul 01 19:45:56.315954 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 16/31] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:56 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:56.327654 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-470055ac-d9b7-409a-83b3-abe1108e65f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:56.350735 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-470055ac-d9b7-409a-83b3-abe1108e65f7 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026705 Jul 01 19:45:56.351311 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 16/32] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 1 19:45:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:45:58.436697 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-b46c2431-5d7f-4fad-a289-1185b521398a admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:45:58.437732 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-b46c2431-5d7f-4fad-a289-1185b521398a admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 01 19:45:58.438153 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 17/33] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:45:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:45:58.498134 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-0b532f34-5cac-417f-a35c-b91644368676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:58.516305 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-0b532f34-5cac-417f-a35c-b91644368676 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.071386 Jul 01 19:45:58.516999 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 17/34] 10.222.0.66 () {64 vars in 1282 bytes} [Fri Jul 1 19:45:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:45:58.529909 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-f42df8ed-b060-4b5e-baab-1296c6cb3804 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:45:58.559137 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-f42df8ed-b060-4b5e-baab-1296c6cb3804 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033245 Jul 01 19:45:58.567570 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 18/35] 10.222.0.66 () {64 vars in 1332 bytes} [Fri Jul 1 19:45:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:46:23.802447 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-0b532f34-5cac-417f-a35c-b91644368676 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:23.803456 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-0b532f34-5cac-417f-a35c-b91644368676 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 01 19:46:23.803860 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 18/36] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:46:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:23.815229 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:23.865369 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-fc2a8b0d-20e0-4e3f-a1eb-3486e6056dec admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:23.882073 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-fc2a8b0d-20e0-4e3f-a1eb-3486e6056dec admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072088 Jul 01 19:46:23.882614 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 19/37] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 1 19:46:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:24.802800 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-0b532f34-5cac-417f-a35c-b91644368676 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:24.803734 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-0b532f34-5cac-417f-a35c-b91644368676 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Jul 01 19:46:24.804130 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 19/38] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:24.994701 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-1013a653-382c-4b79-bae4-54f212c3ab38 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.000234 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.wsgi [None req-1013a653-382c-4b79-bae4-54f212c3ab38 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-1013a653-382c-4b79-bae4-54f212c3ab38 admin admin] Request method failure captured: Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Accept: application/json Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Accept-Encoding: gzip, deflate Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Connection: keep-alive Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Content-Length: 0 Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Host: 10.222.0.66 Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Openstack-Api-Version: compute 2.90 Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Openstack-System-Scope: None Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: User-Agent: python-novaclient Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Auth-Token: gAAAAABiv08QvamNf4zAZGYtYOPL_FPtnkvgiZkuHcVLbo5sZG4qdxXDiRx3dPnaP5OHx2PB9W5-aEMTkCrt7VYAat1ZgFK2R3eR1gwT0DwiriOasAZSKxNoa3K7zYicQ64X4v5ge9u0IIbypmswGGIXP_ALt214bbDuF-s3zJPeZZa2_HJgbUI Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Domain-Id: None Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Domain-Name: None Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Identity-Status: Confirmed Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Is-Admin-Project: True Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Domain-Id: default Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Domain-Name: Default Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Name: admin Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Role: reader,member,admin Jul 01 19:46:25.004267 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Roles: reader,member,admin Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant: admin Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant-Name: admin Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User: admin Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Domain-Id: default Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Domain-Name: Default Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Id: 9d09bdd9927e44ffbfd9b2ec447a5887 Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Name: admin Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: method: > Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: exception: Flavor 42 could not be found. Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: action_args: {'id': '42'} Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:25.005897 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:25.006917 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.008450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-1013a653-382c-4b79-bae4-54f212c3ab38 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:25.009724 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-1013a653-382c-4b79-bae4-54f212c3ab38 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062587 Jul 01 19:46:25.009724 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 20/39] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 1 19:46:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:25.015140 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-3f5c9781-c5a8-4da1-9353-7d38f1379657 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.018168 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:46:25.038000 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-3f5c9781-c5a8-4da1-9353-7d38f1379657 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026304 Jul 01 19:46:25.038541 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 20/40] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 1 19:46:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:25.048726 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-33e3fabf-0dba-45f9-8650-cae6f70cacb7 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.070339 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-33e3fabf-0dba-45f9-8650-cae6f70cacb7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025747 Jul 01 19:46:25.070895 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 1 19:46:25 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:25.080661 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-262f0e29-a722-4a07-9861-c8fcea464501 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.087183 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.wsgi [None req-262f0e29-a722-4a07-9861-c8fcea464501 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-262f0e29-a722-4a07-9861-c8fcea464501 admin admin] Request method failure captured: Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Accept: application/json Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Accept-Encoding: gzip, deflate Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Connection: keep-alive Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Content-Length: 0 Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Host: 10.222.0.66 Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Openstack-Api-Version: compute 2.90 Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Openstack-System-Scope: None Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: User-Agent: python-novaclient Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Auth-Token: gAAAAABiv08QvamNf4zAZGYtYOPL_FPtnkvgiZkuHcVLbo5sZG4qdxXDiRx3dPnaP5OHx2PB9W5-aEMTkCrt7VYAat1ZgFK2R3eR1gwT0DwiriOasAZSKxNoa3K7zYicQ64X4v5ge9u0IIbypmswGGIXP_ALt214bbDuF-s3zJPeZZa2_HJgbUI Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Domain-Id: None Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Domain-Name: None Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Identity-Status: Confirmed Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Is-Admin-Project: True Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Domain-Id: default Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Domain-Name: Default Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Name: admin Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Role: reader,member,admin Jul 01 19:46:25.090491 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Roles: reader,member,admin Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant: admin Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant-Name: admin Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User: admin Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Domain-Id: default Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Domain-Name: Default Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Id: 9d09bdd9927e44ffbfd9b2ec447a5887 Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Name: admin Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: method: > Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: exception: Flavor 42 could not be found. Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: action_args: {'id': '42'} Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:25.092014 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:25.092956 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:25.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-262f0e29-a722-4a07-9861-c8fcea464501 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:25.095687 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-262f0e29-a722-4a07-9861-c8fcea464501 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015135 Jul 01 19:46:25.095687 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 21/42] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 1 19:46:25 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:25.914251 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-33e3fabf-0dba-45f9-8650-cae6f70cacb7 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:25.915295 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-33e3fabf-0dba-45f9-8650-cae6f70cacb7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 01 19:46:25.915692 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 22/43] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:26.109955 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-6fce269b-51ae-4e29-aefa-71feb10c8a01 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:26.115329 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.wsgi [None req-6fce269b-51ae-4e29-aefa-71feb10c8a01 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-6fce269b-51ae-4e29-aefa-71feb10c8a01 admin admin] Request method failure captured: Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Accept: application/json Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Accept-Encoding: gzip, deflate Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Connection: keep-alive Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Content-Length: 0 Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Host: 10.222.0.66 Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Openstack-Api-Version: compute 2.90 Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Openstack-System-Scope: None Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: User-Agent: python-novaclient Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Auth-Token: gAAAAABiv08RQhvfK1kT1Lswy9g4ec-6lj4eIUG876GBJyaBwh1rjEPhUOGs8v6uFF19EQU1nEn9_GwYbZzpaEhh92o4UzxvuWNqmsd1pKspJcMcylUu5vot32yrqZF9o7wLM_yJAe5v27RFja4g8dRF2SAIfhdZPKEejMkdfkgMzRGvRnj0w2w Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Domain-Id: None Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Domain-Name: None Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Identity-Status: Confirmed Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Is-Admin-Project: True Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Domain-Id: default Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Domain-Name: Default Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Name: admin Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Role: reader,member,admin Jul 01 19:46:26.116854 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Roles: reader,member,admin Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant: admin Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant-Name: admin Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User: admin Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Domain-Id: default Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Domain-Name: Default Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Id: 9d09bdd9927e44ffbfd9b2ec447a5887 Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Name: admin Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: method: > Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: exception: Flavor 84 could not be found. Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: action_args: {'id': '84'} Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:26.118533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:26.119426 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.120831 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-6fce269b-51ae-4e29-aefa-71feb10c8a01 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:26.122095 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-6fce269b-51ae-4e29-aefa-71feb10c8a01 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060871 Jul 01 19:46:26.122095 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 22/44] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 1 19:46:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:26.128712 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-38cb44b4-0401-449d-a581-b75c9e8ed918 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:26.144705 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-38cb44b4-0401-449d-a581-b75c9e8ed918 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020506 Jul 01 19:46:26.145235 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 23/45] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 1 19:46:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:26.154881 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-c233122d-3fd2-4cfd-8dab-c53bcdc1d7e7 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:26.168385 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-c233122d-3fd2-4cfd-8dab-c53bcdc1d7e7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017262 Jul 01 19:46:26.168898 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 23/46] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 1 19:46:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:26.178339 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-09ab13ba-a5ab-4c6d-bc23-7074b7711659 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:26.183615 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.wsgi [None req-09ab13ba-a5ab-4c6d-bc23-7074b7711659 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-09ab13ba-a5ab-4c6d-bc23-7074b7711659 admin admin] Request method failure captured: Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Accept: application/json Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Accept-Encoding: gzip, deflate Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Connection: keep-alive Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Content-Length: 0 Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Host: 10.222.0.66 Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Openstack-Api-Version: compute 2.90 Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Openstack-System-Scope: None Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: User-Agent: python-novaclient Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Auth-Token: gAAAAABiv08RQhvfK1kT1Lswy9g4ec-6lj4eIUG876GBJyaBwh1rjEPhUOGs8v6uFF19EQU1nEn9_GwYbZzpaEhh92o4UzxvuWNqmsd1pKspJcMcylUu5vot32yrqZF9o7wLM_yJAe5v27RFja4g8dRF2SAIfhdZPKEejMkdfkgMzRGvRnj0w2w Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Domain-Id: None Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Domain-Name: None Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Identity-Status: Confirmed Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Is-Admin-Project: True Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Domain-Id: default Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Domain-Name: Default Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Name: admin Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Role: reader,member,admin Jul 01 19:46:26.185094 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Roles: reader,member,admin Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant: admin Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant-Name: admin Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User: admin Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Domain-Id: default Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Domain-Name: Default Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Id: 9d09bdd9927e44ffbfd9b2ec447a5887 Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Name: admin Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: method: > Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: exception: Flavor 84 could not be found. Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: action_args: {'id': '84'} Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:26.186634 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:26.187593 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:26.189557 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-09ab13ba-a5ab-4c6d-bc23-7074b7711659 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:26.190766 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-09ab13ba-a5ab-4c6d-bc23-7074b7711659 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011703 Jul 01 19:46:26.190766 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 24/47] 10.222.0.66 () {60 vars in 1190 bytes} [Fri Jul 1 19:46:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:27.016905 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-c233122d-3fd2-4cfd-8dab-c53bcdc1d7e7 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:27.018126 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-c233122d-3fd2-4cfd-8dab-c53bcdc1d7e7 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001660 Jul 01 19:46:27.018528 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 24/48] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:27.234396 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-ab3fc0b4-311f-432b-881e-b000dedfd8e6 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:27.240909 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.wsgi [None req-ab3fc0b4-311f-432b-881e-b000dedfd8e6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-ab3fc0b4-311f-432b-881e-b000dedfd8e6 admin admin] Request method failure captured: Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Accept: application/json Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Accept-Encoding: gzip, deflate Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Connection: keep-alive Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Content-Length: 0 Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Host: 10.222.0.66 Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Openstack-Api-Version: compute 2.90 Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Openstack-System-Scope: None Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: User-Agent: python-novaclient Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Auth-Token: gAAAAABiv08T8skeHYLGr6UHIiUSSakK-4K2dsx2PO3GZdgMnIlMwIAr8Ttunqp2V5iyQ6GDqHImJccM_w9jPC9_yKQNt3Qq6wKbGb_4oeo9WkA43OQtcuw40BspvqMU6zssSxxw52eiqnhWEZRvoqaC0aElyKc8XUo3WK0ZrbBOeKkZcZieYmo Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Domain-Id: None Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Domain-Name: None Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Identity-Status: Confirmed Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Is-Admin-Project: True Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Domain-Id: default Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Domain-Name: Default Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Project-Name: admin Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Role: reader,member,admin Jul 01 19:46:27.242511 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Roles: reader,member,admin Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant: admin Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-Tenant-Name: admin Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User: admin Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Domain-Id: default Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Domain-Name: Default Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Id: 9d09bdd9927e44ffbfd9b2ec447a5887 Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: X-User-Name: admin Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: method: > Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: exception: Flavor 451 could not be found. Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: action_args: {'id': '451'} Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:27.244011 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:27.245012 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.246302 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-ab3fc0b4-311f-432b-881e-b000dedfd8e6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109762) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:27.247519 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-ab3fc0b4-311f-432b-881e-b000dedfd8e6 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060639 Jul 01 19:46:27.247519 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 25/49] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 1 19:46:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:27.253504 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-e3c8f6c5-9dd4-4d20-83f8-c3ec41bb8ffb admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:27.269123 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-e3c8f6c5-9dd4-4d20-83f8-c3ec41bb8ffb admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019265 Jul 01 19:46:27.269690 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 25/50] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 1 19:46:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:27.278937 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:27.293364 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017911 Jul 01 19:46:27.293909 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 26/51] 10.222.0.66 () {60 vars in 1210 bytes} [Fri Jul 1 19:46:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:46:27.304209 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-6331d94d-8066-4d48-a096-c7c674fc401b admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:27.309530 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.wsgi [None req-6331d94d-8066-4d48-a096-c7c674fc401b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-6331d94d-8066-4d48-a096-c7c674fc401b admin admin] Request method failure captured: Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Accept: application/json Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Accept-Encoding: gzip, deflate Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Connection: keep-alive Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Content-Length: 0 Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Host: 10.222.0.66 Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Openstack-Api-Version: compute 2.90 Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Openstack-System-Scope: None Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: User-Agent: python-novaclient Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Auth-Token: gAAAAABiv08T8skeHYLGr6UHIiUSSakK-4K2dsx2PO3GZdgMnIlMwIAr8Ttunqp2V5iyQ6GDqHImJccM_w9jPC9_yKQNt3Qq6wKbGb_4oeo9WkA43OQtcuw40BspvqMU6zssSxxw52eiqnhWEZRvoqaC0aElyKc8XUo3WK0ZrbBOeKkZcZieYmo Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Domain-Id: None Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Domain-Name: None Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Identity-Status: Confirmed Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Is-Admin-Project: True Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Openstack-Nova-Api-Version: 2.90 Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Domain-Id: default Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Domain-Name: Default Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Project-Name: admin Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Role: reader,member,admin Jul 01 19:46:27.311044 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Roles: reader,member,admin Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/54a2d5d499f64a6a8437120d4d4f1f46"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant: admin Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant-Id: 54a2d5d499f64a6a8437120d4d4f1f46 Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-Tenant-Name: admin Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User: admin Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Domain-Id: default Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Domain-Name: Default Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Id: 9d09bdd9927e44ffbfd9b2ec447a5887 Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: X-User-Name: admin Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: method: > Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: exception: Flavor 451 could not be found. Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: action_args: {'id': '451'} Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:46:27.312544 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:27.313480 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: ERROR nova.api.openstack.wsgi Jul 01 19:46:27.314743 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-6331d94d-8066-4d48-a096-c7c674fc401b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109763) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:46:27.315933 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-6331d94d-8066-4d48-a096-c7c674fc401b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011696 Jul 01 19:46:27.315933 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 26/52] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 1 19:46:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 01 19:46:28.150293 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:28.151334 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 01 19:46:28.151728 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 27/53] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:46:28.341186 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-913dd6e5-3169-4dad-98a5-c26f586abf40 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:28.359481 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-913dd6e5-3169-4dad-98a5-c26f586abf40 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069135 Jul 01 19:46:28.359950 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 27/54] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 1 19:46:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:46:29.190824 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:29.192030 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001804 Jul 01 19:46:29.192430 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 28/55] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:29.390593 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-e7f861a7-198c-485d-9f58-150aca771db1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:29.409738 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-e7f861a7-198c-485d-9f58-150aca771db1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070473 Jul 01 19:46:29.410293 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 28/56] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 1 19:46:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:46:30.232526 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:30.233565 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 01 19:46:30.233992 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 29/57] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:30.426142 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-efa6c8d6-4658-4cd5-8889-bb2657eb1c36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:30.446253 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-efa6c8d6-4658-4cd5-8889-bb2657eb1c36 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.073159 Jul 01 19:46:30.446733 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 29/58] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 1 19:46:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:46:31.269194 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:31.270238 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 01 19:46:31.270648 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 30/59] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:31.462327 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-53f490e4-2898-4560-b81c-9397fc7077ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:46:31.479654 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-53f490e4-2898-4560-b81c-9397fc7077ad admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.068135 Jul 01 19:46:31.480178 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 30/60] 10.222.0.66 () {64 vars in 1235 bytes} [Fri Jul 1 19:46:31 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:46:32.300986 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:32.302036 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 01 19:46:32.302439 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 31/61] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:46:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:46:32.491911 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-7bfb92ee-01f0-4861-bfbb-c5e30c45ea7a admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:46:32.512245 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-7bfb92ee-01f0-4861-bfbb-c5e30c45ea7a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071460 Jul 01 19:46:32.512707 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 31/62] 10.222.0.66 () {60 vars in 1202 bytes} [Fri Jul 1 19:46:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:19.722050 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:19.723058 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-e632c4a4-623b-47ef-bb10-281296fa2d8f admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 01 19:47:19.723463 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 32/63] 10.222.0.66 () {54 vars in 930 bytes} [Fri Jul 1 19:47:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:47:19.733832 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:19.783833 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-bb563b54-ea40-461a-a635-92067241d54a admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:19.802488 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-bb563b54-ea40-461a-a635-92067241d54a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073098 Jul 01 19:47:19.803029 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 32/64] 10.222.0.66 () {60 vars in 1291 bytes} [Fri Jul 1 19:47:19 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:47:19.825596 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-aee474b9-5463-4a08-ac46-2e0f156a4764 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:19.829602 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG dbcounter [-] [109762] Writing DB stats nova_api:SELECT=14 {{(pid=109762) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:47:19.835450 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-aee474b9-5463-4a08-ac46-2e0f156a4764 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013371 Jul 01 19:47:19.835974 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 33/65] 10.222.0.66 () {60 vars in 1282 bytes} [Fri Jul 1 19:47:19 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:19.848078 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-e5f37f4f-bd7d-479e-a359-5b239b59c0d3 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:19.855570 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-e5f37f4f-bd7d-479e-a359-5b239b59c0d3 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011665 Jul 01 19:47:19.856083 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 33/66] 10.222.0.66 () {60 vars in 1285 bytes} [Fri Jul 1 19:47:19 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:19.867279 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:19.874707 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010917 Jul 01 19:47:19.875218 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 34/67] 10.222.0.66 () {60 vars in 1285 bytes} [Fri Jul 1 19:47:19 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:47:19.886013 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-86276633-df49-4a81-a1d5-b17009f6413a admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:47:19.894084 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-86276633-df49-4a81-a1d5-b17009f6413a admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011460 Jul 01 19:47:19.894598 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 34/68] 10.222.0.66 () {60 vars in 1282 bytes} [Fri Jul 1 19:47:19 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:50:39.094722 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:39.095731 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 01 19:50:39.096154 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 35/69] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:50:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:50:39.242918 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_api:SELECT=6 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:39.360402 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-a24390c8-8f1f-46b5-b090-2cf1333d0aa1 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:39.361559 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:50:39.361559 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: warnings.warn(msg) Jul 01 19:50:39.362769 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a24390c8-8f1f-46b5-b090-2cf1333d0aa1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:39.363203 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a24390c8-8f1f-46b5-b090-2cf1333d0aa1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:39.363983 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a24390c8-8f1f-46b5-b090-2cf1333d0aa1 admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:39.364405 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-a24390c8-8f1f-46b5-b090-2cf1333d0aa1 admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:39.399417 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-a24390c8-8f1f-46b5-b090-2cf1333d0aa1 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157796 Jul 01 19:50:39.400006 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 35/70] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 1 19:50:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:50:40.232369 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:40.233404 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Jul 01 19:50:40.233841 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 36/71] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:50:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:50:40.426516 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-e1db0aa1-f115-4271-a31a-b660e2fcf47d admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:40.427678 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:50:40.427678 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: warnings.warn(msg) Jul 01 19:50:40.428851 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-e1db0aa1-f115-4271-a31a-b660e2fcf47d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:40.429290 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-e1db0aa1-f115-4271-a31a-b660e2fcf47d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:40.430106 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-e1db0aa1-f115-4271-a31a-b660e2fcf47d admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:40.430533 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-e1db0aa1-f115-4271-a31a-b660e2fcf47d admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:40.450002 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-e1db0aa1-f115-4271-a31a-b660e2fcf47d admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075381 Jul 01 19:50:40.450550 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 36/72] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 1 19:50:40 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:50:51.700949 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:51.702089 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Jul 01 19:50:51.702487 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 37/73] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:50:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:50:51.847274 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_cell0:SELECT=4 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:51.848003 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_cell1:SELECT=4 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:51.848660 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG dbcounter [-] [109763] Writing DB stats nova_api:SELECT=8 {{(pid=109763) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:50:51.897836 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-60f851b8-73da-4270-9336-54e035395913 admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:51.898995 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:50:51.898995 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: warnings.warn(msg) Jul 01 19:50:51.900170 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-60f851b8-73da-4270-9336-54e035395913 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:51.900615 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-60f851b8-73da-4270-9336-54e035395913 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:51.901424 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-60f851b8-73da-4270-9336-54e035395913 admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:51.901882 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-60f851b8-73da-4270-9336-54e035395913 admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:51.927362 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-60f851b8-73da-4270-9336-54e035395913 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.084538 Jul 01 19:50:51.927905 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 37/74] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 1 19:50:51 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:50:52.751990 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: DEBUG nova.api.openstack.wsgi [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] Calling method '>' {{(pid=109762) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:52.752994 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: INFO nova.api.openstack.requestlog [None req-830a70e3-eddf-45ea-8548-4b2c9049f7f8 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 01 19:50:52.753393 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: [pid: 109762|app: 0|req: 38/75] 10.222.0.66 () {56 vars in 1074 bytes} [Fri Jul 1 19:50:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:50:52.947319 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG nova.api.openstack.wsgi [None req-b9e28507-24a7-4fd3-bfc9-9ac6d3da7c9c admin admin] Calling method '>' {{(pid=109763) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:50:52.948485 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 01 19:50:52.948485 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: warnings.warn(msg) Jul 01 19:50:52.949896 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-b9e28507-24a7-4fd3-bfc9-9ac6d3da7c9c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:52.950281 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-b9e28507-24a7-4fd3-bfc9-9ac6d3da7c9c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:52.951080 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-b9e28507-24a7-4fd3-bfc9-9ac6d3da7c9c admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:50:52.951509 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: DEBUG oslo_concurrency.lockutils [None req-b9e28507-24a7-4fd3-bfc9-9ac6d3da7c9c admin admin] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109763) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:50:52.973567 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: INFO nova.api.openstack.requestlog [None req-b9e28507-24a7-4fd3-bfc9-9ac6d3da7c9c admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078630 Jul 01 19:50:52.974148 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: [pid: 109763|app: 0|req: 38/76] 10.222.0.66 () {60 vars in 1193 bytes} [Fri Jul 1 19:50:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:51:49.771857 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: Fri Jul 1 19:51:49 2022 - graceful shutdown triggered... Jul 01 19:51:49.772355 dv-cinder-844601-7-iscsi devstack@n-api.service[109763]: Gracefully killing worker 2 (pid: 109763)... Jul 01 19:51:49.771983 dv-cinder-844601-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 01 19:51:49.773131 dv-cinder-844601-7-iscsi devstack@n-api.service[109762]: Gracefully killing worker 1 (pid: 109762)... Jul 01 19:51:50.773011 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: worker 1 buried after 1 seconds Jul 01 19:51:50.773011 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: worker 2 buried after 1 seconds Jul 01 19:51:50.773662 dv-cinder-844601-7-iscsi devstack@n-api.service[109761]: goodbye to uWSGI. Jul 01 19:51:50.774627 dv-cinder-844601-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 01 19:51:50.775174 dv-cinder-844601-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 01 19:51:50.778108 dv-cinder-844601-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 01 19:51:50.788132 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 1 19:51:50 2022] *** Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: nodename: dv-cinder-844601-7-iscsi Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: machine: x86_64 Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: clock source: unix Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: pcre jit disabled Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: detected number of CPU cores: 4 Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: current working directory: / Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: detected binary path: /usr/bin/uwsgi-core Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: your processes number limit is 47680 Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: your memory page size is 4096 bytes Jul 01 19:51:50.790184 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: detected max file descriptor number: 2048 Jul 01 19:51:50.790989 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: lock engine: pthread robust mutexes Jul 01 19:51:50.790989 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: thunder lock: enabled Jul 01 19:51:50.790989 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 01 19:51:50.790989 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 01 19:51:50.836523 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: Python main interpreter initialized at 0x564e3d17f9c0 Jul 01 19:51:50.836523 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: python threads support enabled Jul 01 19:51:50.836523 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: your server socket listen backlog is limited to 100 connections Jul 01 19:51:50.836523 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: your mercy for graceful operations on workers is 90 seconds Jul 01 19:51:50.836927 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: mapped 403077 bytes (393 KB) for 2 cores Jul 01 19:51:50.836927 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: *** Operational MODE: preforking *** Jul 01 19:51:50.854573 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: *** uWSGI is running in multiple interpreter mode *** Jul 01 19:51:50.854573 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: spawned uWSGI master process (pid: 124269) Jul 01 19:51:50.854573 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: spawned uWSGI worker 1 (pid: 124286, cores: 1) Jul 01 19:51:50.854573 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: spawned uWSGI worker 2 (pid: 124287, cores: 1) Jul 01 19:51:50.854573 dv-cinder-844601-7-iscsi devstack@n-api.service[124269]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 01 19:51:50.837442 dv-cinder-844601-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 01 19:51:51.511191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:51:51.549459 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 01 19:51:52.722868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:51:52.722868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: from cryptography.utils import int_from_bytes Jul 01 19:51:52.723507 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:51:52.723507 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: from cryptography.utils import int_from_bytes Jul 01 19:51:52.786972 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:51:52.786972 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: from cryptography.utils import int_from_bytes Jul 01 19:51:52.787651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 01 19:51:52.787651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: from cryptography.utils import int_from_bytes Jul 01 19:51:55.188541 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:51:55.189097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:51:55.189342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:51:55.189728 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:51:55.189989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:51:55.190371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.190698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.191016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.191332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.191659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.191965 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.192285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.192600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.192926 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.193541 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.193541 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.193821 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-7-iscsi {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.194141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.194446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.194755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.195071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.195391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.195689 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.195995 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.196511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.197831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.197831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.197831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.198262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.198262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.198581 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.198852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.199130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.199491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.199752 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.200962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-7-iscsi {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.201925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.202236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.202556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.202980 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.203295 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.203607 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.203936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.204254 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.204561 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.204887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.205205 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.205519 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.205866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.206166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.206474 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.206782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.207100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.207406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.207707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.207956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.208260 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.208579 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.208899 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.209224 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.209474 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.209746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.210062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.210381 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.210686 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.210991 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.211295 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.211600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.211904 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.212208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.212512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.212816 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.212968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 01 19:51:55.213375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.213466 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 01 19:51:55.213547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.213773 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 01 19:51:55.213885 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.214078 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.214183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 01 19:51:55.214382 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 01 19:51:55.214484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.214773 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.214872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.215020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.215112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.215324 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.215422 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.215663 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.215771 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.216076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.216472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.216575 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.216793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.216892 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.217117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.217216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.217437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.217621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.217723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.217815 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218132 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218361 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844601-7-iscsi {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218466 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218678 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.218989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219087 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219391 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219552 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219652 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219851 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.219989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.220154 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.220252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.220473 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.220580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.220782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221014 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.221987 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.222088 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.222290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.222392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.222595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.222760 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.222901 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223320 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223514 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223818 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.223909 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.224120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.224224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.224422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.224550 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844601-7-iscsi {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.224738 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.224872 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.225056 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.225190 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.225364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.225512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.225703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.225956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226275 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226444 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226591 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226900 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.226998 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.227208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.227308 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.227523 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.227696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.227855 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228003 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228180 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228501 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228625 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228823 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.228913 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.229129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.229230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.229443 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.229545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.229782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.229890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230820 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.230972 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.231064 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.231291 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.231405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.231750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232055 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232366 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232635 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232734 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232889 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.232989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.233210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.233302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.233534 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.233659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.233873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.233966 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.234187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.234279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.234491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.234581 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.234797 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.234897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.235099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.235191 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.235407 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.235511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.235718 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.235810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.236029 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.236130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.236349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.236449 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.236668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.236770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.236994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.237092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.237306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.237406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.237639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.237745 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.237953 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.238054 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.238267 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.238372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.238581 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.238672 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.238888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.238986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.239198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.239299 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.239505 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.239606 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.239821 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.239921 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.240135 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.240272 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.240448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.240591 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.240758 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.240848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.241072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.241164 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.241387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.241477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.241718 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.241811 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.242035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.242129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.242293 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.242391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.242601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.242701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.242912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.243011 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.243237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.243329 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.243551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.243656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.243865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.243967 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.244179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.244322 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.244486 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.244594 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.244797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.244888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.245108 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.245205 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.245417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.245519 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.245751 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.245852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.246067 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.246159 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.246375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.246472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.246684 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.246774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.247506 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.247611 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.247818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.248139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.248327 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.248464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.248645 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.248777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.248959 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.249090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.249273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.249401 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.249644 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.249757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.249946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.250038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.250260 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.250360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.250572 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.250705 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.250887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.251080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.251199 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.251394 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.251493 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.251711 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.251802 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.252032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.252133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.252344 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.252451 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.252655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.252746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.252969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.253066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.253270 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.253374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.253588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.253681 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.253914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.254016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.254221 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.254324 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.254528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.254621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.254835 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.254926 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.255139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.255230 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.255444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.255533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.255750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.255841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.256052 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.256143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.256354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.256444 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.256655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.256790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.257496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.257662 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.257766 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.257860 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.257945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.258080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.258174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.258265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.258360 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.258451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.258535 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.258625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 01 19:51:55.258763 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.258871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.259074 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.259173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.259382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.259482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.259690 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.259827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260627 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.260938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.261038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.261247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.261339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.261593 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.261688 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.261923 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.262016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.262227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.262326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.262549 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.263257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.263460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.263784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.263934 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.264115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.264247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.264436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.264580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.264759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.264861 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.265081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.265174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.265395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.265486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.265740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.265835 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266452 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266661 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.266953 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267255 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267558 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267658 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267878 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.267969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.268186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.268286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.268489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.268582 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.268790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.268882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.269092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.269195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.269431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.269523 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.269761 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.269903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.270100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.270202 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.270434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.270525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.270750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.270915 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.271065 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.271166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.271379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.271508 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.271694 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.271811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272102 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272412 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272622 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272712 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.272930 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273247 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.273989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.274205 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.274296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.274519 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.274647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.274830 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.274925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.275140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.275242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.275441 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.275538 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.275751 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.275843 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.276059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.276156 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.276393 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.276500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.276700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.276797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277007 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277412 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.277964 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.278061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.278306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.278419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.278622 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.279192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.279335 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.279508 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.279651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.279820 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.279977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.280131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.280278 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.280426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.280578 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.280742 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.280892 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.281049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.281195 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.281380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.281488 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.281723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.281829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282036 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282172 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282767 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.282983 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.283082 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.283300 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.283404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.283614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.283705 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.283934 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284649 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.284978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.285168 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.285268 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.285471 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.285563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.285806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.285907 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.286122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.286223 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.286430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.286521 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.286739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.286877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287652 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.287955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288046 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288257 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288414 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288562 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288661 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.288963 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.289176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.289269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.289483 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.289608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.289813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.289905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.290125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.290216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.290428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.290533 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.290732 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.290830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291146 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.291942 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.292042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.292280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.292375 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.292587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.292679 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.292893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.293022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.293208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.293326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.293526 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.293661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.293927 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.294041 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.294253 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.294577 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.294729 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.294888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.295051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.295208 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.295363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.295531 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.295685 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.295846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296625 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.296938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.297115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.297235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.297438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.297531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.297772 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.297886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.298090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.298183 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.298432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.298531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.298765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.298865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.299067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.299165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.299376 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.299467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.299691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.299797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.300006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.300266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.300359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.300602 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.300694 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.300915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301052 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301552 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.301975 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.302196 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.302332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.302510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.302608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.302836 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.302936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.303145 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.303253 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.303454 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.303554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.303759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.303857 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304060 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304368 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304459 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304674 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.304981 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.305102 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.305288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.305392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.305626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.305723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.305917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306011 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306219 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306520 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306619 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.306916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.307133 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.307233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.307434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.307533 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.307745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.307838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308666 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.308969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.309070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.309271 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.309371 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.310232 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.310390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.310656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.310865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.310958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.311200 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.311302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.311520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.311656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.311850 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.311949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.312178 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.312278 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.312490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.312591 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.312799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.312905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.313120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.313212 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.313423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.313517 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.313754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.313862 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314160 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314368 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314458 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314783 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.314975 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.315068 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.315285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.315448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.315591 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.315704 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.315904 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316004 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316212 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316313 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316609 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316823 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.316922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.317125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.317252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.317436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.317539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.317769 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.317865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318171 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318374 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318466 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318774 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.318988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.319081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.319288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.319388 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.319596 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.319697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.319896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.320915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.321113 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.321205 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.321421 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.321564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.321753 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322017 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322449 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322766 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.322966 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323571 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323873 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.323965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.324173 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.324265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.324479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.324579 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.324798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.324903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.325191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.325978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.326074 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.326339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.326533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.326656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.326852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327027 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.327866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328084 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.328996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.329090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.329298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.329398 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.329634 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.329768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.329945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330053 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330254 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330345 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330699 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330860 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.330960 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.331162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.331268 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.331477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.331570 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.331785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.331894 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.332130 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.332245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.332432 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.332524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.332745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.332847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.333062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.333166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.333372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.333471 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.333714 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.333809 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.334955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.335048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.335264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.335356 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.335566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.335666 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.335867 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336005 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336583 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336800 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.336900 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.337112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.337211 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.337426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.337521 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.337757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.337860 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338057 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338469 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338670 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338770 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.338976 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339075 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339281 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339586 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339686 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.339994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.340204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.340309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.340510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.340603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.340868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.341175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.341338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.341502 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.341704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.341868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342154 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342314 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342423 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342627 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.342934 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.343077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.343257 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.343396 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.343569 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.343707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.343874 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344018 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344168 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344310 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344768 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.344911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.345066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.345206 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.345394 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.345543 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.345737 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.345846 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.346065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.346216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.346387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.346487 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.346694 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.346800 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347003 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347308 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347492 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347618 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347767 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.347913 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.348078 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.348226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.348496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.348588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.348811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.348903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.349119 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.349209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.349425 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.349525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.349755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.349859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350058 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350474 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350675 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350775 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.350977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351278 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351681 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351902 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.351993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.352206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.352316 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.352526 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.352626 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.352863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.352962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.353187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.353280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.353504 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.353605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.353844 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.353971 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.354167 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.354302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.354478 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.354578 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.354797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.354902 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.355112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.355209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.355428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.355528 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.355736 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.355829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.356042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.356168 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.356433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.356582 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.356769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.357173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.357267 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.357503 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.357650 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.357841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.357942 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.358158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.358259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.358468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.358562 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.358792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.358885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.359114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.359253 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.359427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.359520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.359739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.359839 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.360053 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.360146 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.360433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.360533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.360754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.360928 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.361077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.361400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.361498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.361757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.361942 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.362067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.362376 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.362475 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.362682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.362903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.363002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.363296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.363395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.363601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.363859 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.363965 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.364210 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.364399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.364516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.364819 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.364919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.365123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.365309 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.365444 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.365773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.365869 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.366096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.366298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.366439 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.366719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.366841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.367039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.367279 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.367392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.367648 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.367785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.367954 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.368256 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.368472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.368574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.368846 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.368939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.369185 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.369389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.369505 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.369831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.369926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.370162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.370380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.370474 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.370780 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.370880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.371109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.371357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.371460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.371787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.371898 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.372840 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.372994 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.373400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.373515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.373651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.373953 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.374046 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.374263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.374484 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.374580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.374859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.374975 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.375164 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.375454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.375556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.375759 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.375932 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.376066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.376364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.376642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.376798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.376956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.377110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.377290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.377435 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.377630 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.377863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.377976 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.378236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.378335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.378538 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.378827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.378928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.379171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.379306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.379503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.379805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.379907 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.380131 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.380454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.380556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.380759 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.380945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.381080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.381395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.381499 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.381732 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.382049 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.382153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.382364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.382563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.382676 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.382979 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.383079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.383292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.383538 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.383643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.383900 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.384043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.384215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.384528 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.384629 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.385009 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.385109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.385367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.385498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.385724 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.386018 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.386142 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.386337 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.386530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.386661 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.386964 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.387074 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.387274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.387703 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.388392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.388692 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.388935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.389047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.389252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.389378 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.389566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.389755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.389918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.390096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.390243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.390443 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.390578 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.390885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.390991 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.391220 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.391319 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.391524 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.391636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.391839 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.392037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.392193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.392290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.392509 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.392604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.392956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.393061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.393302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.393525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.393673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.393960 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.394110 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.394271 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.394581 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.394676 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.394894 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.395208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.395312 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.395519 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.395769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.395872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.396124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.396330 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.396436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.396746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.396894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.397075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.397395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.397498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.397740 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.397999 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.398102 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.398359 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.398559 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.398912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.399135 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.399238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.399547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.399681 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.399870 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.400192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.400286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.400508 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.400814 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.400918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.401138 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.401390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.401501 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.401764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.402013 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.402121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.402367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.402512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.402666 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.402988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.403141 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.403372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.403547 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.404124 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.404448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.404554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.404762 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.404863 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.405160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.405257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.405475 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.405720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.405818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.406075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.406170 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.406392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.406492 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.406718 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.406827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407356 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407457 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407660 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407761 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.407982 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.408082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.408292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.408383 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.408595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.408687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.408909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409002 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409220 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409320 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409524 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409643 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409869 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.409962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.410177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.410277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.410485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.410585 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.410788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.410879 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.411096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.411188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.411395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.411510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.411723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.411834 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412326 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412455 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412629 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412732 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.412939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413673 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413870 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.413973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.414186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.414286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.414487 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.414593 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.414788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.414890 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.415096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.415198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.415398 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.415504 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.415706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.415799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416100 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416311 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416413 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416762 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.416983 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.417118 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.418387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.418590 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.418687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.418781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.418893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419009 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419089 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419168 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419344 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.419997 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.420091 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.420339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.420443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.420678 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.420923 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.421031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.421262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.421363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.421624 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.421793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.421949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.422096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.422269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.422424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.422581 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.422733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.422878 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423030 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423644 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.423955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.424101 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.424256 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.424399 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.424567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.424883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425480 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425649 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.425961 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426247 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426389 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426803 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426906 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.426995 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.427104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.427297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.427486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.427653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.427815 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.427976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428128 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428271 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428526 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.428945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.429159 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.429259 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.429473 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.429563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.429807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.429916 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.430112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.430203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.430422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.430514 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.430741 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.430847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.431070 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.431169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.431382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.431475 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.431685 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.431778 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.432015 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.432202 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.432324 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.432518 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.432836 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.432981 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.433155 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.433300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.433457 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.433555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.433792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.433926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.434115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.434218 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.435081 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.435203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.435294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.435723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.435826 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436046 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436763 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.436985 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.437086 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.437294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.437467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.437626 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.437732 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.437946 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438250 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438344 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438561 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.438983 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.439188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.439411 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.439504 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.439764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.439916 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440076 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440170 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440381 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440686 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.440988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.441089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.441291 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.441394 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.441620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.441720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.441930 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.442025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.442658 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.442810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.442935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443448 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443675 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443796 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.443910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444020 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444131 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444521 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444636 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.444978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.445227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.445372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.445540 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.445678 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.445793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.445904 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.446100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.446223 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.446419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.446582 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.446835 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.447032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.447153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.447487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.447803 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.448119 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.448420 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.448637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.448847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449357 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449549 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449683 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.449953 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.450193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.451150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.451490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.451618 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.451805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.451952 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.452114 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.452243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.452436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.452568 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.452754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.452890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.453082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.453211 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.453398 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.453553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.453778 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.453876 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.454128 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.454232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.454448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.454542 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.454812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.454995 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.455136 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.455334 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.455464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.455660 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.455765 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.455997 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.456161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.456331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.456434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.456640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.456751 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.456948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457256 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457414 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457558 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457695 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.457992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.458216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.458465 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.458573 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.458659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.458818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.458920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.459135 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.459240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.459445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.459546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.459756 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.459888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460093 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460683 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460784 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.460992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.461093 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.461302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.461404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.461629 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.461727 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.461947 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.462042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.462188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:51:55.462290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.462599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.462917 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.463236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.463555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.463866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.464187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.464488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.464800 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.465117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.465448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.465808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.466120 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.466643 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.466964 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.467295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.467621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.467994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.468256 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.468588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.468954 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.469245 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.469530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.470010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.470228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.470549 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.470875 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.471184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.471492 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.471801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.472114 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.472433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.472747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.473049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.473353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.473990 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.474228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.474540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.474851 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.475717 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.475717 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.476034 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.476034 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.476348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.476658 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.477383 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.477383 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.477566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.478106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.478401 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.478715 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.479025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.479332 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.479668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.480003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.480410 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.480642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.480956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.481280 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.481682 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.482007 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.482331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.482657 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.482967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.483335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.483651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.483969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.484284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.484599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.484913 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.485228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.485560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.485919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.486229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.486556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.486877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.487200 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.487519 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.487835 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.488166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.488480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.488794 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.489114 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.489428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.489776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.490094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.490467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.490733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.491059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.491371 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.491699 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.492026 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.492372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.492688 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.493033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.493360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.493699 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.494016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.494324 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 01 19:51:55.494566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124286) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 01 19:51:55.527098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO dbcounter [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Registered counter for database nova_api Jul 01 19:51:55.549491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.556419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writer thread running {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.558542 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO dbcounter [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Registered counter for database nova_api Jul 01 19:51:55.579458 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_db.sqlalchemy.engines [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.586207 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writer thread running {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.616417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.context [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc420076-a5c0-4107-825e-ec6145e40494(cell1) {{(pid=124287) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:51:55.620911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:55.623421 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:55.624230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:55.626280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:55.628275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO dbcounter [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Registered counter for database nova_cell0 Jul 01 19:51:55.632447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO dbcounter [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Registered counter for database nova_cell1 Jul 01 19:51:55.641330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.643077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.context [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc420076-a5c0-4107-825e-ec6145e40494(cell1) {{(pid=124286) load_cells /opt/stack/nova/nova/context.py:464}} Jul 01 19:51:55.646383 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writer thread running {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.647023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.647220 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:55.648821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:55.649652 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:51:55.651641 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:51:55.653708 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO dbcounter [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Registered counter for database nova_cell0 Jul 01 19:51:55.658085 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO dbcounter [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Registered counter for database nova_cell1 Jul 01 19:51:55.665244 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_db.sqlalchemy.engines [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.670883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writer thread running {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.671536 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_db.sqlalchemy.engines [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.796786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writer thread running {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.805437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO dbcounter [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Registered counter for database nova_cell0 Jul 01 19:51:55.813659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_db.sqlalchemy.engines [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.817889 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writer thread running {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.818518 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writer thread running {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:55.826845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO dbcounter [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Registered counter for database nova_cell0 Jul 01 19:51:55.834112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_db.sqlalchemy.engines [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124286) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 01 19:51:55.838436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writer thread running {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 01 19:51:56.144635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: WARNING keystonemiddleware.auth_token [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:51:56.151901 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: WARNING keystonemiddleware.auth_token [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:51:56.157955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: WARNING keystonemiddleware.auth_token [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:51:56.165129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: WARNING keystonemiddleware.auth_token [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:51:56.496945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: WARNING keystonemiddleware.auth_token [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:51:56.502946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: WARNING keystonemiddleware.auth_token [None req-dcc0b097-1135-4f23-9cca-7d823151404f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:51:56.505047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: WARNING keystonemiddleware.auth_token [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 01 19:51:56.508241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e3d17f9c0 pid: 124287 (default app) Jul 01 19:51:56.511001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: WARNING keystonemiddleware.auth_token [None req-9ceda967-1328-4eb9-a411-828fced58547 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 01 19:51:56.516734 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564e3d17f9c0 pid: 124286 (default app) Jul 01 19:52:39.593094 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:39.594962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:39.596294 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:39.599506 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:41.132618 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b49305e1-cc00-481a-827f-22731ae677de tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Action: 'create', calling method: .version_select at 0x7fa00d6383a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-449268230", "metadata": {"Type": "work"}}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b49305e1-cc00-481a-827f-22731ae677de tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Request method failure captured: Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 121 Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CH839JDbaYQQuobxYeGkh1TXJaATZz6f755lgue8AW27P9gwJsaVwZX-k09XgzJEam42HnyWHsC8PQYteRvAuEyOkMS3yV0js4KBffjyCvDVbHxmNwy-ULVEbewgOqEcfACrfR67fRtq8ndl9dnOpIBl7vBynHjRXpKnZuyDnK_BY Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:52:41.163827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3e80908e6ccb48ec984fa11268437eaa Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-449268230", "metadata": {"Type": "work"}}} Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 19:52:41.165216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-449268230', 'metadata': {'Type': 'work'}}}} Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise error Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi '#$%' Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:41.166187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 19:52:41.169111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 19:52:41.170355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 01 19:52:41.170355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.171824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b49305e1-cc00-481a-827f-22731ae677de tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:41.173009 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b49305e1-cc00-481a-827f-22731ae677de tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.600344 Jul 01 19:52:41.173858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 1 19:52:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:52:41.795106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6a7546e1-a9c7-4862-bb6c-e9cde154aba3 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Action: 'create', calling method: .version_select at 0x7fa00d766430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2039757761", "metadata": {"Type": "work"}}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6a7546e1-a9c7-4862-bb6c-e9cde154aba3 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Request method failure captured: Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 120 Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CH839JDbaYQQuobxYeGkh1TXJaATZz6f755lgue8AW27P9gwJsaVwZX-k09XgzJEam42HnyWHsC8PQYteRvAuEyOkMS3yV0js4KBffjyCvDVbHxmNwy-ULVEbewgOqEcfACrfR67fRtq8ndl9dnOpIBl7vBynHjRXpKnZuyDnK_BY Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:52:41.800304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3e80908e6ccb48ec984fa11268437eaa Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2039757761", "metadata": {"Type": "work"}}} Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: Jul 01 19:52:41.801933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2039757761', 'metadata': {'Type': 'work'}}}} Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise error Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi '0' Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:41.802691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 19:52:41.803957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 19:52:41.805146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 01 19:52:41.805146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.806669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6a7546e1-a9c7-4862-bb6c-e9cde154aba3 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:41.808158 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6a7546e1-a9c7-4862-bb6c-e9cde154aba3 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.627158 Jul 01 19:52:41.812014 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 1/2] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 1 19:52:41 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 633 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 01 19:52:41.822660 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db98f8fe-4e72-4044-9d18-b34ff21d4f0a tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Action: 'create', calling method: .version_select at 0x7fa00d5e4790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1597926484", "metadata": {"Type": "work"}}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db98f8fe-4e72-4044-9d18-b34ff21d4f0a tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Request method failure captured: Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 119 Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CH839JDbaYQQuobxYeGkh1TXJaATZz6f755lgue8AW27P9gwJsaVwZX-k09XgzJEam42HnyWHsC8PQYteRvAuEyOkMS3yV0js4KBffjyCvDVbHxmNwy-ULVEbewgOqEcfACrfR67fRtq8ndl9dnOpIBl7vBynHjRXpKnZuyDnK_BY Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:52:41.825651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3e80908e6ccb48ec984fa11268437eaa Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1597926484", "metadata": {"Type": "work"}}} Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 19:52:41.826918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1597926484', 'metadata': {'Type': 'work'}}}} Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise error Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi '' Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:41.827677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 01 19:52:41.828914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 01 19:52:41.833987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 01 19:52:41.833987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:41.833987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db98f8fe-4e72-4044-9d18-b34ff21d4f0a tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:41.833987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-db98f8fe-4e72-4044-9d18-b34ff21d4f0a tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008492 Jul 01 19:52:41.833987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 2/3] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 1 19:52:41 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:52:41.837493 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3acda293-7bfa-4d5c-b6dd-5bc31f1bb9f8 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Calling method '.version_select at 0x7fa00d5a0160>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:41.896988 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:41.898245 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:41.899198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:41.900423 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:52:42.610149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-3acda293-7bfa-4d5c-b6dd-5bc31f1bb9f8 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] HTTP exception thrown: Volume tempest-invalid-1945026569 could not be found. Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3acda293-7bfa-4d5c-b6dd-5bc31f1bb9f8 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Request method failure captured: Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1945026569 HTTP/1.1 Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CH839JDbaYQQuobxYeGkh1TXJaATZz6f755lgue8AW27P9gwJsaVwZX-k09XgzJEam42HnyWHsC8PQYteRvAuEyOkMS3yV0js4KBffjyCvDVbHxmNwy-ULVEbewgOqEcfACrfR67fRtq8ndl9dnOpIBl7vBynHjRXpKnZuyDnK_BY Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:52:42.619090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3e80908e6ccb48ec984fa11268437eaa Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Volume tempest-invalid-1945026569 could not be found. Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'tempest-invalid-1945026569'} Jul 01 19:52:42.621719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1945026569 could not be found. (HTTP 404) (Request-ID: req-12ea66ca-1615-47de-b9e3-69898af8a98c) Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:42.622687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:52:42.623817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1945026569 could not be found. Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:52:42.624911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1945026569 could not be found. Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1945026569 could not be found. Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3acda293-7bfa-4d5c-b6dd-5bc31f1bb9f8 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Returning 404 to user: Volume tempest-invalid-1945026569 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:42.626061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3acda293-7bfa-4d5c-b6dd-5bc31f1bb9f8 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1945026569" status: 404 len: 99 microversion: 2.1 time: 0.790169 Jul 01 19:52:42.631791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 2/4] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 1 19:52:41 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1945026569 => generated 99 bytes in 794 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 01 19:52:42.643603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7bc26ead-55e6-44d4-a913-383fc2e654ee tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008939 Jul 01 19:52:42.644327 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 3/5] 10.222.0.66 () {58 vars in 1139 bytes} [Fri Jul 1 19:52:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 19:52:42.660566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4b017c80-5eea-422c-a1f8-f74685541e4c tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009484 Jul 01 19:52:42.661827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 3/6] 10.222.0.66 () {58 vars in 1136 bytes} [Fri Jul 1 19:52:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 01 19:52:42.672160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4effb229-f89d-46b5-879a-50a01d7b8e20 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Calling method '.version_select at 0x7fa00d638550>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:43.006609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-4effb229-f89d-46b5-879a-50a01d7b8e20 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] HTTP exception thrown: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4effb229-f89d-46b5-879a-50a01d7b8e20 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Request method failure captured: Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/os-volumes/f8838f98-0940-4445-a0aa-d2cf0031f161 HTTP/1.1 Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CH839JDbaYQQuobxYeGkh1TXJaATZz6f755lgue8AW27P9gwJsaVwZX-k09XgzJEam42HnyWHsC8PQYteRvAuEyOkMS3yV0js4KBffjyCvDVbHxmNwy-ULVEbewgOqEcfACrfR67fRtq8ndl9dnOpIBl7vBynHjRXpKnZuyDnK_BY Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:52:43.012832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3e80908e6ccb48ec984fa11268437eaa Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'f8838f98-0940-4445-a0aa-d2cf0031f161'} Jul 01 19:52:43.014417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. (HTTP 404) (Request-ID: req-a8615035-d0df-4d32-9923-1b5bda7cdbb0) Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:43.015177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:52:43.016438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 19:52:43.020865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4effb229-f89d-46b5-879a-50a01d7b8e20 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Returning 404 to user: Volume f8838f98-0940-4445-a0aa-d2cf0031f161 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4effb229-f89d-46b5-879a-50a01d7b8e20 tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/f8838f98-0940-4445-a0aa-d2cf0031f161" status: 404 len: 109 microversion: 2.1 time: 0.347853 Jul 01 19:52:43.023233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 4/7] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 19:52:42 2022] DELETE /compute/v2.1/os-volumes/f8838f98-0940-4445-a0aa-d2cf0031f161 => generated 109 bytes in 352 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:52:43.026749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc9860b0-3e0a-41db-9ef0-7df6a6027b3d tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Calling method '.version_select at 0x7fa00d4729d0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:43.098108 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-cc9860b0-3e0a-41db-9ef0-7df6a6027b3d tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] HTTP exception thrown: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc9860b0-3e0a-41db-9ef0-7df6a6027b3d tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Request method failure captured: Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/os-volumes/deed715e-98f8-4b63-85a6-b585452c575b HTTP/1.1 Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CH839JDbaYQQuobxYeGkh1TXJaATZz6f755lgue8AW27P9gwJsaVwZX-k09XgzJEam42HnyWHsC8PQYteRvAuEyOkMS3yV0js4KBffjyCvDVbHxmNwy-ULVEbewgOqEcfACrfR67fRtq8ndl9dnOpIBl7vBynHjRXpKnZuyDnK_BY Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:52:43.098726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8ff2d50730e24f3b9983e44416421b05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 8ff2d50730e24f3b9983e44416421b05 Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesNegativeTest-1775376575 Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3e80908e6ccb48ec984fa11268437eaa Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesNegativeTest-1775376575-project Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'deed715e-98f8-4b63-85a6-b585452c575b'} Jul 01 19:52:43.100121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. (HTTP 404) (Request-ID: req-4323959f-6944-4ce1-bb11-adbff9e2abf4) Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:43.110294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:52:43.111560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:52:43.112604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc9860b0-3e0a-41db-9ef0-7df6a6027b3d tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] Returning 404 to user: Volume deed715e-98f8-4b63-85a6-b585452c575b could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cc9860b0-3e0a-41db-9ef0-7df6a6027b3d tempest-VolumesNegativeTest-1775376575 tempest-VolumesNegativeTest-1775376575-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/deed715e-98f8-4b63-85a6-b585452c575b" status: 404 len: 109 microversion: 2.1 time: 0.079001 Jul 01 19:52:43.114387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 4/8] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 19:52:43 2022] GET /compute/v2.1/os-volumes/deed715e-98f8-4b63-85a6-b585452c575b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:52:53.223143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bc07b63e-cb1d-4ae4-981f-b997b9d4842e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'create', calling method: .version_select at 0x7fa00dd58d30>, body: {"keypair": {"name": "tempest-keypair-1293309274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPSvSYKTOo3EM4799s+K89h6ePlg7DWhvA7KTmof9jnCUXwjsrVKLS+Jdf9eIaW41SOAae1N3218GNmsUyczwc4ZpjIhB5xJ9X4YUuOcDZaq6Iy9GyvhV0qLQKpkh53SgA=="}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:53.355234 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-bc07b63e-cb1d-4ae4-981f-b997b9d4842e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:52:53.374002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-bc07b63e-cb1d-4ae4-981f-b997b9d4842e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for user 3307be3159654f55be46e75c82584bf0 and project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:52:53.492951 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bc07b63e-cb1d-4ae4-981f-b997b9d4842e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.998080 Jul 01 19:52:53.493671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 5/9] 10.222.0.66 () {62 vars in 1199 bytes} [Fri Jul 1 19:52:52 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1000 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 01 19:52:54.329053 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1431384279", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:54.723788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] validate_networks() for [('13dd580c-809a-4f73-9432-a6d0838269e1', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:52:57.539579 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:52:57.540200 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:52:57.540464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:52:57.541740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:52:57.542330 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:52:57.572497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:57.573285 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:57.575838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:52:57.576530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:52:57.650653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:52:57.664811 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for user 0267350339c44000bcc49906cfa8f0a6 and project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:52:57.715294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:52:57.718209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:52:57.942613 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f2183618-7d4d-4766-9bf8-55b861c17904 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.000643 Jul 01 19:52:57.943896 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 5/10] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:52:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 4002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:52:57.958296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-51039c01-d82c-4791-95c0-eb07cd88bdfb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:52:57.968551 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-51039c01-d82c-4791-95c0-eb07cd88bdfb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:52:58.228227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-51039c01-d82c-4791-95c0-eb07cd88bdfb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:52:58.271203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-51039c01-d82c-4791-95c0-eb07cd88bdfb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1222 microversion: 2.1 time: 0.320066 Jul 01 19:52:58.272294 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 6/11] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:52:57 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1222 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:52:58.654026 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-823282270", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:58.893265 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] validate_networks() for [('13dd580c-809a-4f73-9432-a6d0838269e1', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:52:58.904462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-efb27739-6c52-4d0a-bd78-518f95b7a90f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: .version_select at 0x7fa00cb941f0>, body: {"keypair": {"name": "tempest-keypair-715139908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKnO1kExrH2uOHOtG8uHTsAds8Ts3EjoesEnklhdVDVwyRzcTAs57JvG9HK8InRccrYlLFNSZLJqwl/3TCoOgv1txxv1BD4073sjGO7SDC5mMGkQ8PEZ3xRBoNIogGVWbA=="}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:52:58.955179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-efb27739-6c52-4d0a-bd78-518f95b7a90f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for project 025035b3b0b348d7acddfe456dd6a109. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:52:58.968684 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-efb27739-6c52-4d0a-bd78-518f95b7a90f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for user 3198a63f6d1a4cdd88d76189658e79c0 and project 025035b3b0b348d7acddfe456dd6a109. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:52:59.049077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-efb27739-6c52-4d0a-bd78-518f95b7a90f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.736785 Jul 01 19:52:59.060776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 6/12] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:52:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:53:00.545082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-257720471", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "networks": [{"uuid": "345d49d7-38ed-4bce-826c-0115d69ba214"}]}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:00.683183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] validate_networks() for [('345d49d7-38ed-4bce-826c-0115d69ba214', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:53:03.060566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:53:03.061812 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:53:03.062479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:53:03.063107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:53:03.064136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:53:03.118954 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:03.119453 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:03.125082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:03.125564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:03.175728 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Getting quotas for project 2347fd8e4a1740fdb98218aa30c150e0. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:03.183833 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Getting quotas for user 71647f9f93ec4235818d27640058d25c and project 2347fd8e4a1740fdb98218aa30c150e0. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:03.211473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:53:03.221376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:53:03.338936 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-edd6f3b9-0bf2-4be3-9dc1-4d46eedaaa6e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.483752 Jul 01 19:53:03.339945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 7/13] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:52:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 19:53:03.346393 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1184238253", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e9d88c7-2969-402f-b3c2-096acc062b79"}], "security_groups": [{"name": "tempest-securitygroup--1588459152"}], "key_name": "tempest-keypair-1293309274", "user_data": "}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:03.517285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:53:03.517837 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:53:03.518448 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:53:03.519693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:53:03.520147 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:53:03.542394 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:03.544467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:03.545489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:03.550392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:03.595405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:03.600354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for user 0267350339c44000bcc49906cfa8f0a6 and project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:03.636386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:53:03.640046 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:53:03.882161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c205bcf4-9fdb-4298-bf96-274c6733c480 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.234407 Jul 01 19:53:03.884119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 7/14] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:52:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 5237 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 19:53:03.896158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e1911170-4b63-475a-826d-9ab124d095ad tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:03.898035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e1911170-4b63-475a-826d-9ab124d095ad tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:04.063253 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] validate_networks() for [('7e9d88c7-2969-402f-b3c2-096acc062b79', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:53:04.280218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e1911170-4b63-475a-826d-9ab124d095ad tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:04.288975 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e1911170-4b63-475a-826d-9ab124d095ad tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1214 microversion: 2.1 time: 0.402699 Jul 01 19:53:04.297388 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 8/15] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:03 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1214 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:04.325555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d4e841fd-3136-4faf-8a2c-f330d7bb3607 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:04.328353 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d4e841fd-3136-4faf-8a2c-f330d7bb3607 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:04.895609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d4e841fd-3136-4faf-8a2c-f330d7bb3607 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:04.910621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d4e841fd-3136-4faf-8a2c-f330d7bb3607 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1221 microversion: 2.1 time: 0.611222 Jul 01 19:53:04.911201 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 9/16] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:04 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1221 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:05.307785 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:05.308787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:05.339371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:05.340278 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:05.341279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:05.344066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:05.955428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:05.986289 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-49de400d-bf05-48ff-a63c-df8fd8c5b460 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1218 microversion: 2.1 time: 0.683491 Jul 01 19:53:05.988956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 10/17] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:05 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1218 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:06.012010 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1227821538", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b31a2a85-453d-4d0b-bc1f-fd678ffc85ef"}], "security_groups": [{"name": "tempest-securitygroup--2024459991"}], "key_name": "tempest-keypair-715139908", "user_data": "}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:06.722677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] validate_networks() for [('b31a2a85-453d-4d0b-bc1f-fd678ffc85ef', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:53:07.629006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:53:07.630160 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:53:07.631177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:53:07.631799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:53:07.632413 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:53:07.652441 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:07.653462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:07.654437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:07.655107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:07.727788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:07.744687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for user 3307be3159654f55be46e75c82584bf0 and project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:07.799116 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:53:07.809258 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:53:07.973636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-444c334b-5e0b-4203-aecc-d48e53d1253a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.631497 Jul 01 19:53:07.977084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 8/18] 10.222.0.66 () {62 vars in 1187 bytes} [Fri Jul 1 19:53:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 4636 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 19:53:07.992271 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:07.993148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:08.038315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:08.042942 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:08.045434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:08.047430 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:09.497309 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:09.564864 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dc690338-36b5-4c5e-8281-771d48dff2e2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1279 microversion: 2.1 time: 1.582742 Jul 01 19:53:09.568031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 9/19] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:07 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1279 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:09.580845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:09.592188 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:09.635733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:09.637049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:09.638565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:09.642631 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.210590 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:10.234728 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-92550e0e-0f25-4baf-8315-780c266c512c tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1272 microversion: 2.1 time: 0.663156 Jul 01 19:53:10.250437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 10/20] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:09 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1272 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:10.264706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:10.266497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:10.285018 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:10.286954 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.295757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:10.297048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.508551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:10.543038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:10.546652 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:10.554621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-900f3ae7-7b70-40b0-9c20-cd73759fa825 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1334 microversion: 2.20 time: 0.300309 Jul 01 19:53:10.557350 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 11/21] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:10 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1334 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:10.583126 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:10.583749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:10.596772 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:10.597227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.602802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:10.604846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.849400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:53:10.851105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:53:10.852177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:53:10.854903 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:53:10.855928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:53:10.887371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:10.888616 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.891482 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:10.892736 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:10.982369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for project 025035b3b0b348d7acddfe456dd6a109. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:11.002416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for user 3198a63f6d1a4cdd88d76189658e79c0 and project 025035b3b0b348d7acddfe456dd6a109. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:11.064952 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:53:11.067286 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:53:11.269827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f7a587e2-8c0c-4afa-a4be-2cb4110170f9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.268044 Jul 01 19:53:11.270529 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 11/22] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:53:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 5272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:53:11.300067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:11.303549 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:11.331946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:11.332674 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:11.336001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:11.338755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:12.047003 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:12.054828 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e295dfd5-3bd6-4af9-b83f-f7182627485a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1272 microversion: 2.1 time: 0.783128 Jul 01 19:53:12.068171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:11 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1272 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:12.084211 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-49e04f92-eb47-423f-a37f-90120d6a6bcf tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:12.084530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-49e04f92-eb47-423f-a37f-90120d6a6bcf tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:12.427832 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:12.440439 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5282a7a1-72fa-4571-90c9-83b623c772dd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 1.860861 Jul 01 19:53:12.442204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 12/24] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:10 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:12.454177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:12.457736 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:12.462934 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-49e04f92-eb47-423f-a37f-90120d6a6bcf tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:12.471943 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-49e04f92-eb47-423f-a37f-90120d6a6bcf tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1237 microversion: 2.1 time: 0.402595 Jul 01 19:53:12.478077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 13/25] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:12 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1237 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:12.486913 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:12.488149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:12.491293 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:12.492559 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:12.745245 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:12.767550 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:12.769632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:12.773311 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1057aace-817b-4b45-a7bc-6df56184bb63 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1340 microversion: 2.20 time: 0.327457 Jul 01 19:53:12.774204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 13/26] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:12 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1340 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:13.075899 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:13.077820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:13.112002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:13.112814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:13.115269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:13.115886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:13.461207 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:13.462749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:13.476919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:13.479595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:13.483099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:13.485248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:14.451938 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:14.462813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1d5f5d2f-2b2c-4e7a-b07c-46c1c4d8050d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 1.006700 Jul 01 19:53:14.484881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 14/27] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:13 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:14.497065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:14.498373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:14.518416 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:14.520786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:14.522569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:14.526754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:14.784304 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:14.804117 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d3df3eb1-fdd2-41f3-af9c-d9346094ef0a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 1.733202 Jul 01 19:53:14.806497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 14/28] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:13 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:14.848404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:14.852300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:14.866957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:14.871629 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:14.873406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:14.875296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:14.970733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:14.996494 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-43824986-7519-4d0d-bdf1-c5525787f272 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1307 microversion: 2.1 time: 0.500904 Jul 01 19:53:15.000040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 15/29] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:14 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1307 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:15.079656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:15.106664 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:15.115150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:15.116495 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-172a7ec3-d151-4b8f-8261-13ec8908365e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1340 microversion: 2.20 time: 0.308613 Jul 01 19:53:15.120965 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 15/30] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:14 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1340 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:15.492294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:15.494148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:15.530488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:15.530989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:15.531810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:15.532248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:15.823597 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:15.824203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:15.842641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:15.843096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:15.843882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:15.844326 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.379223 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:17.390693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6af4caf5-6a6b-48a3-85a2-350249948767 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 1.570773 Jul 01 19:53:17.404752 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 16/31] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:15 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:17.413828 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:17.422785 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:17.446440 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:17.447263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.449946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:17.451027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.642644 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:17.657767 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-01c186e9-a691-4755-803c-b5424826f402 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 2.165162 Jul 01 19:53:17.660042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 16/32] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:15 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 2172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:17.668799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:17.679276 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:17.705648 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=6 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:17.707362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:17.707811 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.708672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:17.709233 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:17.788211 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=22 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:18.112058 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:18.125419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-27006bd5-0c7e-4cd4-8537-576c7243b161 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1295 microversion: 2.1 time: 0.719464 Jul 01 19:53:18.138285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 17/33] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:17 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1295 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:18.599878 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-2083e9a4-d4c4-41ab-9827-a904db37a352 req-1301950d-a10c-41b1-87db-51e5f8406fdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1148781-931f-4460-a8e3-7f3654799ce7", "tag": "c14e2e69-9a6f-4043-8f05-6857744162f2"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:18.620742 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-2083e9a4-d4c4-41ab-9827-a904db37a352 req-1301950d-a10c-41b1-87db-51e5f8406fdf service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:18.625152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-2083e9a4-d4c4-41ab-9827-a904db37a352 req-1301950d-a10c-41b1-87db-51e5f8406fdf service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:18.672062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-2083e9a4-d4c4-41ab-9827-a904db37a352 req-1301950d-a10c-41b1-87db-51e5f8406fdf service nova] Creating event network-changed:c14e2e69-9a6f-4043-8f05-6857744162f2 for instance e1148781-931f-4460-a8e3-7f3654799ce7 on hv-cinder-84460 Jul 01 19:53:18.672917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-2083e9a4-d4c4-41ab-9827-a904db37a352 req-1301950d-a10c-41b1-87db-51e5f8406fdf service nova] Acquired lock "compute-rpcapi-router" {{(pid=124287) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 19:53:18.675962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:18.685820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:18.685820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:18.685820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:18.705470 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.compute.rpcapi [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 19:53:18.706402 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] Releasing lock "compute-rpcapi-router" {{(pid=124287) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 19:53:18.751049 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-780e786d-b311-4a2a-ad8a-0e5c8d0d7a8c None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.607835 Jul 01 19:53:18.751957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:18.770035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:18.770035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:18.779881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:18.780218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:18.780996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:18.781437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:19.298986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:19.314559 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:19.316184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:19.329986 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:19.341868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-48839cb1-ac31-401e-9f8e-77ab50a32aa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 1.663939 Jul 01 19:53:19.347035 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 17/35] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:17 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 1686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:19.358756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c6371639-4547-483d-b64a-a3da5f18019b tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.605536 Jul 01 19:53:19.359533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 19/36] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:18 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:19.363912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:19.370426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:19.383013 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:19.383471 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:19.384864 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:19.385341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:19.639361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-e4dd2f32-9ca3-4603-93b1-8cee32dbf9f3 req-d74aec93-2990-4739-be5c-c8124d58886d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68aa76c-bae5-43da-9f08-50f825938444", "tag": "644f4558-dca6-454f-9465-da30f533731d"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:19.672988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-e4dd2f32-9ca3-4603-93b1-8cee32dbf9f3 req-d74aec93-2990-4739-be5c-c8124d58886d service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:19.674125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-e4dd2f32-9ca3-4603-93b1-8cee32dbf9f3 req-d74aec93-2990-4739-be5c-c8124d58886d service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:19.739660 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-e4dd2f32-9ca3-4603-93b1-8cee32dbf9f3 req-d74aec93-2990-4739-be5c-c8124d58886d service nova] Creating event network-changed:644f4558-dca6-454f-9465-da30f533731d for instance a68aa76c-bae5-43da-9f08-50f825938444 on hv-cinder-84460 Jul 01 19:53:19.795007 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-e4dd2f32-9ca3-4603-93b1-8cee32dbf9f3 req-d74aec93-2990-4739-be5c-c8124d58886d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.433374 Jul 01 19:53:19.800139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 20/37] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:19.824552 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:19.825367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:19.852326 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:19.854357 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:19.855391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:19.855811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.086863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:20.100151 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8b4b7015-dec6-4ae5-ae18-47dad526b242 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.751110 Jul 01 19:53:20.101991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 18/38] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:19 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:20.238583 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:20.250506 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a4bd565e-1613-420b-9ff4-c87194f71d5e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.448345 Jul 01 19:53:20.257311 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 21/39] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:19 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:20.364303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:20.365184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:20.377712 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:20.378338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:20.384575 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.385027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.385830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.386273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.391269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.391671 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.392443 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.392868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.700434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:20.709112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:20.711408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:20.714035 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-62975d11-e170-4de9-8193-cf4093264a4e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.353229 Jul 01 19:53:20.715297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 19/40] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:20 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:20.724560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:20.733759 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1bba6041-7f31-4fcd-90e0-5f6882641f44 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.359746 Jul 01 19:53:20.734752 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 22/41] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:20 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:20.871556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-b524529d-7328-4350-8b1d-ae84cd16b6e9 req-681276e2-dc15-4be4-a71f-dfa907f0ecdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:20.886913 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b524529d-7328-4350-8b1d-ae84cd16b6e9 req-681276e2-dc15-4be4-a71f-dfa907f0ecdd service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.888008 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b524529d-7328-4350-8b1d-ae84cd16b6e9 req-681276e2-dc15-4be4-a71f-dfa907f0ecdd service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.913764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-b524529d-7328-4350-8b1d-ae84cd16b6e9 req-681276e2-dc15-4be4-a71f-dfa907f0ecdd service nova] Creating event network-changed:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:53:20.925379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b524529d-7328-4350-8b1d-ae84cd16b6e9 req-681276e2-dc15-4be4-a71f-dfa907f0ecdd service nova] Acquired lock "compute-rpcapi-router" {{(pid=124286) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 01 19:53:20.926993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.929561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.932171 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:20.932642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:20.961718 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.compute.rpcapi [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 01 19:53:20.963941 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] Releasing lock "compute-rpcapi-router" {{(pid=124286) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 01 19:53:20.988256 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8f4d6673-a948-4175-92a1-60fca5f00e5f None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120833 Jul 01 19:53:20.989619 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 20/42] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:21.121437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:21.122113 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:21.135969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.136417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.139793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.140241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.276396 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:21.277209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:21.284276 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.284842 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.285832 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.286341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.836524 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:21.852025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ad117d62-ecce-4bb5-98b0-ac1b593b2849 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.735894 Jul 01 19:53:21.859218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 23/43] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:21 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:21.872844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:21.873489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:21.879708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.880339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.881286 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.881950 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.940808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:21.962598 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ba318302-58b6-4ac7-8204-b177854879d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.691277 Jul 01 19:53:21.963262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 21/44] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:21 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:21.975750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:21.977047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:21.991348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.992366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:21.996933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:21.998050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:22.283126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:22.299410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:22.301245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:22.302615 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-22a6bb19-bfb4-4330-bd6b-72e7a27d2187 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.442131 Jul 01 19:53:22.303486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 24/45] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:21 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:22.314752 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-16123d70-be0f-4ea5-94d6-6733a7c7753d req-0fe5b727-bf30-4411-ae0c-1abb73250dff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f809d6-179b-4d3c-a955-d8aa4ad1ee38", "tag": "e95ca826-2651-40ec-803c-c0c94b2615d4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:22.339412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-16123d70-be0f-4ea5-94d6-6733a7c7753d req-0fe5b727-bf30-4411-ae0c-1abb73250dff service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:22.341999 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-16123d70-be0f-4ea5-94d6-6733a7c7753d req-0fe5b727-bf30-4411-ae0c-1abb73250dff service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:22.366131 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-16123d70-be0f-4ea5-94d6-6733a7c7753d req-0fe5b727-bf30-4411-ae0c-1abb73250dff service nova] Creating event network-changed:e95ca826-2651-40ec-803c-c0c94b2615d4 for instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 on hv-cinder-84460 Jul 01 19:53:22.374611 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-16123d70-be0f-4ea5-94d6-6733a7c7753d req-0fe5b727-bf30-4411-ae0c-1abb73250dff service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068463 Jul 01 19:53:22.390174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 25/46] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:22.410268 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:22.423329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b98a085e-16ff-4c7f-92fb-d84d5ad8349e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.457339 Jul 01 19:53:22.430133 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 22/47] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:21 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:22.871946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=24 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:22.876895 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:22.877995 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:22.888794 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:22.891232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:22.891871 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:22.893171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:22.893790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:22.980206 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:22.981442 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:23.002324 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.002782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.003673 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.006323 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.268962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:23.286500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-507e98f5-bd8b-4499-9c10-387700c3d88b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.415378 Jul 01 19:53:23.303184 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 26/48] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:22 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:23.308967 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-c7e90ae7-a638-4c55-83c8-114d77e3f2b0 req-0c148182-cf50-49c6-b10d-3f86cc451780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a80874-00ef-4d4b-8ef0-7a604ed7458e", "tag": "230a6a60-1da3-425e-8ff1-35512f5f96c2"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:23.313195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:23.321658 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2787e671-247d-4df0-97d6-f6239832affa tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.346363 Jul 01 19:53:23.325100 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 23/49] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:22 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:23.349804 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:23.353935 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:23.366761 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-c7e90ae7-a638-4c55-83c8-114d77e3f2b0 req-0c148182-cf50-49c6-b10d-3f86cc451780 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.370266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-c7e90ae7-a638-4c55-83c8-114d77e3f2b0 req-0c148182-cf50-49c6-b10d-3f86cc451780 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.381140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.381825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.382755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.391524 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-c7e90ae7-a638-4c55-83c8-114d77e3f2b0 req-0c148182-cf50-49c6-b10d-3f86cc451780 service nova] Creating event network-changed:230a6a60-1da3-425e-8ff1-35512f5f96c2 for instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e on hv-cinder-84460 Jul 01 19:53:23.392427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.428799 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-c7e90ae7-a638-4c55-83c8-114d77e3f2b0 req-0c148182-cf50-49c6-b10d-3f86cc451780 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123969 Jul 01 19:53:23.429447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 27/50] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:23.444705 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:23.447236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:23.473365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.473927 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.475212 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:23.475660 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:23.927092 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:23.931554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:23.944535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:23.947236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:23.949896 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6c254600-ec8e-4e2c-82f8-9e384b27b4e1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.611408 Jul 01 19:53:23.954596 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 24/51] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:23 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:23.984560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:23.994583 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-244d4d6b-a1d4-4c75-b66a-a463058f744f tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.555500 Jul 01 19:53:23.999922 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 28/52] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:23 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:24.310691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:24.312047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:24.322609 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=10 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:24.324777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:24.326948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:24.329048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:24.329627 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:24.342996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:24.343603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:24.356437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:24.356889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:24.370733 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:24.371370 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:24.916829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:24.931611 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a43ebad0-7028-4723-be69-a67a9525a396 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.588900 Jul 01 19:53:24.935171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 29/53] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:24 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:24.973137 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:24.974600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:24.986789 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:24.991250 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:24.992342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:24.993718 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:25.004950 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=100 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:25.184877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:25.198298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a81dc8ce-7fd2-4d75-9cca-ffd99011d246 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.891750 Jul 01 19:53:25.205815 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 25/54] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:24 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:25.220812 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:25.221477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:25.245298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:25.248700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:25.249674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:25.250167 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:25.718779 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:25.733034 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:25.734579 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:25.735914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-451fc075-815d-49ad-889c-f3c5e7978d6a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.767285 Jul 01 19:53:25.747486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 30/55] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:24 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:25.952074 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:25.953238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:25.965473 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:25.966876 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:25.970065 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:25.970719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:26.046578 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:26.059703 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a41119bd-777b-4e1c-9544-77af01de47e7 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.848617 Jul 01 19:53:26.069772 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 26/56] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:25 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:26.218697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:26.219645 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:26.242691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:26.243888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:26.245099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:26.247250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:26.309368 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:26.324840 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-33defea1-9669-422a-8161-dc5d86a00766 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.376814 Jul 01 19:53:26.326712 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 31/57] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:25 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:26.716923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:26.739423 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e008523c-c2bb-4285-8594-c32629690431 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.523856 Jul 01 19:53:26.740037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 27/58] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:26 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:26.755317 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:26.756387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:26.775186 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:26.775730 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:26.776669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:26.777863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.036377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-aacef0bb-fb01-40f8-bf5c-df2dcefeb9ce req-1ed0ce3b-410c-4042-a3f8-5c18094d2abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1148781-931f-4460-a8e3-7f3654799ce7", "name": "network-vif-plugged", "status": "completed", "tag": "c14e2e69-9a6f-4043-8f05-6857744162f2"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:27.055400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-aacef0bb-fb01-40f8-bf5c-df2dcefeb9ce req-1ed0ce3b-410c-4042-a3f8-5c18094d2abc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.056389 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-aacef0bb-fb01-40f8-bf5c-df2dcefeb9ce req-1ed0ce3b-410c-4042-a3f8-5c18094d2abc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.087193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-aacef0bb-fb01-40f8-bf5c-df2dcefeb9ce req-1ed0ce3b-410c-4042-a3f8-5c18094d2abc service nova] Creating event network-vif-plugged:c14e2e69-9a6f-4043-8f05-6857744162f2 for instance e1148781-931f-4460-a8e3-7f3654799ce7 on hv-cinder-84460 Jul 01 19:53:27.099516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-aacef0bb-fb01-40f8-bf5c-df2dcefeb9ce req-1ed0ce3b-410c-4042-a3f8-5c18094d2abc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.423802 Jul 01 19:53:27.100181 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 32/59] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:27.135202 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:27.137659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:27.154299 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.154739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.155531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.156932 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.208063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:27.219590 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:27.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:27.226846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f181e98e-c7a3-4f30-9049-dfebf9e26d5c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.475094 Jul 01 19:53:27.228409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 28/60] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:26 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:27.344620 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:27.345446 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:27.353038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.353878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.355536 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.356777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.603874 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:27.615547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b0129697-0328-43d3-aae8-894e16fe79a0 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.503296 Jul 01 19:53:27.619043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 33/61] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:27 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:27.757021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:27.760155 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:27.773070 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.775491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:27.779384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:27.781228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:28.038060 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:28.054039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c8667f97-4cda-46f4-8176-f532ed810dc9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.710948 Jul 01 19:53:28.064687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 29/62] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:27 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:28.072605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:28.084534 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-62cbb9a7-fff7-46c8-b108-801b039d981f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.331503 Jul 01 19:53:28.088031 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 34/63] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:27 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:28.249417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:28.250364 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:28.256320 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:28.256927 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:28.258269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:28.259276 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:28.412572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:28.426129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:28.428607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:28.430416 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-78ac2b31-1278-4859-863c-d80affc89ee0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.188225 Jul 01 19:53:28.431862 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 30/64] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:28 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:28.634998 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:28.636167 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:28.642574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:28.643249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:28.644197 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:28.644607 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:28.700493 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:28.820595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:28.831355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-12c4ab30-4a23-42b9-8dd9-fffdfcd674d6 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.199881 Jul 01 19:53:28.833624 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 35/65] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:28 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:29.074144 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:29.074857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:29.080791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.081237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.082261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.082707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.103191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:29.103861 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:29.110730 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.111553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.112370 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.112879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.511287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:29.511762 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:29.522390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a2602bfe-ad3f-408d-976e-0c351e641289 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.453069 Jul 01 19:53:29.534271 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 31/66] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:29 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:29.536666 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c305749a-fddd-41a8-a83a-1962227cb57c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.437390 Jul 01 19:53:29.539086 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 36/67] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:29 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:29.543033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:29.558006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:29.565215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.567295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.568607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.569475 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.760894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:29.778679 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:29.781932 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:29.786490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ef810ac4-275a-4e61-8cb4-49522b51b2ad tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.252199 Jul 01 19:53:29.787450 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 32/68] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:29 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:29.849915 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:29.850909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:29.866355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.867233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.869067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:29.869948 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:29.998267 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-c3e70f3b-23af-4160-899b-497daee568be req-18cdc5e1-74a6-412b-ae47-bc5ebb9c0908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "name": "network-vif-plugged", "status": "completed", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:30.018938 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-c3e70f3b-23af-4160-899b-497daee568be req-18cdc5e1-74a6-412b-ae47-bc5ebb9c0908 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.019387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-c3e70f3b-23af-4160-899b-497daee568be req-18cdc5e1-74a6-412b-ae47-bc5ebb9c0908 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:30.066531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:30.076536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-385bb5a2-ba3f-4317-9620-2cf71bd6c6c2 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.231405 Jul 01 19:53:30.077612 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 37/69] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:29 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:30.104572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-c3e70f3b-23af-4160-899b-497daee568be req-18cdc5e1-74a6-412b-ae47-bc5ebb9c0908 service nova] Creating event network-vif-plugged:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:53:30.116858 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-c3e70f3b-23af-4160-899b-497daee568be req-18cdc5e1-74a6-412b-ae47-bc5ebb9c0908 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122339 Jul 01 19:53:30.120029 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 33/70] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:30.542066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:30.542800 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:30.558032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:30.559888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:30.568743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.570432 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.571840 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:30.572782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.573444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:30.574339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.574942 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:30.577916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:30.925883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:30.940821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:30.941980 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cd986bf2-1b6b-4051-b8d7-ad8a64687c04 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.401905 Jul 01 19:53:30.943092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 38/71] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:30 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:30.950986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-db2b0c05-7077-4cc9-a9ff-4a7d30d6949f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.398237 Jul 01 19:53:30.951759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 34/72] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:30 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:30.968609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:30.970037 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:30.983489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.984238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:30.985162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:30.985781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:31.101210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:31.102986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:31.107096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:31.116838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:31.125929 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:31.129958 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:31.134801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:31.429856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:31.442460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:31.444044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:31.450440 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1727ee35-afb3-41b5-9729-d09fd809e32c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1408 microversion: 2.20 time: 0.504396 Jul 01 19:53:31.451308 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 39/73] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:30 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1408 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:31.605262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:31.616406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3db67b22-5bdc-4980-8594-31df0b9da45a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.526560 Jul 01 19:53:31.618852 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 35/74] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:31 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:31.960547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:31.962737 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:31.970472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:31.970848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:31.971189 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:31.971924 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:31.973250 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:31.974806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:31.982476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:31.983327 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:31.984399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:31.985435 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:32.222897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:32.235456 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a8e2cbc3-44e9-4f32-8228-3e8840c8a47f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.270706 Jul 01 19:53:32.237911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 36/75] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:31 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:32.252143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-a0523ed8-1d03-4783-9b23-886cb606f5e2 req-c0d82a57-1d46-4c99-91e5-e1d2ac3bf300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68aa76c-bae5-43da-9f08-50f825938444", "name": "network-vif-plugged", "status": "completed", "tag": "644f4558-dca6-454f-9465-da30f533731d"}, {"server_uuid": "c7f809d6-179b-4d3c-a955-d8aa4ad1ee38", "name": "network-vif-plugged", "status": "completed", "tag": "e95ca826-2651-40ec-803c-c0c94b2615d4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:32.283252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-a0523ed8-1d03-4783-9b23-886cb606f5e2 req-c0d82a57-1d46-4c99-91e5-e1d2ac3bf300 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:32.283252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-a0523ed8-1d03-4783-9b23-886cb606f5e2 req-c0d82a57-1d46-4c99-91e5-e1d2ac3bf300 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:32.303575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-a0523ed8-1d03-4783-9b23-886cb606f5e2 req-c0d82a57-1d46-4c99-91e5-e1d2ac3bf300 service nova] Creating event network-vif-plugged:644f4558-dca6-454f-9465-da30f533731d for instance a68aa76c-bae5-43da-9f08-50f825938444 on hv-cinder-84460 Jul 01 19:53:32.304534 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-a0523ed8-1d03-4783-9b23-886cb606f5e2 req-c0d82a57-1d46-4c99-91e5-e1d2ac3bf300 service nova] Creating event network-vif-plugged:e95ca826-2651-40ec-803c-c0c94b2615d4 for instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 on hv-cinder-84460 Jul 01 19:53:32.313918 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-a0523ed8-1d03-4783-9b23-886cb606f5e2 req-c0d82a57-1d46-4c99-91e5-e1d2ac3bf300 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.071780 Jul 01 19:53:32.315040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 37/76] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:32.368923 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:32.377824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0993071e-65e7-4503-8b54-501849b9d784 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.421848 Jul 01 19:53:32.378568 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 40/77] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:31 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:32.470025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:32.470725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:32.482544 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:32.486290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:32.488131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:32.488692 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:32.634500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:32.635117 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:32.641112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:32.641812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:32.642824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:32.643203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.058585 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:33.073790 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:33.075296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:33.076675 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bcbf1fdd-d335-418a-b322-d43e003aac91 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1600 microversion: 2.20 time: 0.611826 Jul 01 19:53:33.077783 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 38/78] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:53:32 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1600 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:53:33.098299 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:33.098885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:33.109957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:33.116885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:33.117331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.118751 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:33.123262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-087dbf85-b379-4744-9749-738ce0cbc005 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.493022 Jul 01 19:53:33.123842 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 41/79] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:32 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:33.124356 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.261706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:33.262177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e42f503a-ce71-4d41-a502-17326cd5738e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.170614 Jul 01 19:53:33.262768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 39/80] 10.222.0.66 () {60 vars in 1315 bytes} [Fri Jul 1 19:53:33 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:53:33.263104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:33.279030 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:33.279804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.281206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:33.282044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.395766 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:33.396692 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:33.411179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:33.411708 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.412558 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:33.413123 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:33.482861 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:33.494396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8c53511e-31f4-419f-8f31-5fb7e1ad20a5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.239988 Jul 01 19:53:33.495161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 42/81] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:33 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:33.682539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:33.717749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-957a2e72-a371-4bf8-a25a-bb927c3aea44 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.325365 Jul 01 19:53:33.719608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 40/82] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:33 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:34.142361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:34.142973 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:34.158600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.159255 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.160039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.160476 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.347153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-e658262d-2a8f-4e5c-96e6-5b0baa5eb1aa req-8ce4ea55-845d-492d-8c0f-a7bd77575451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a80874-00ef-4d4b-8ef0-7a604ed7458e", "name": "network-vif-plugged", "status": "completed", "tag": "230a6a60-1da3-425e-8ff1-35512f5f96c2"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:34.363656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-e658262d-2a8f-4e5c-96e6-5b0baa5eb1aa req-8ce4ea55-845d-492d-8c0f-a7bd77575451 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.364111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-e658262d-2a8f-4e5c-96e6-5b0baa5eb1aa req-8ce4ea55-845d-492d-8c0f-a7bd77575451 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.393997 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-e658262d-2a8f-4e5c-96e6-5b0baa5eb1aa req-8ce4ea55-845d-492d-8c0f-a7bd77575451 service nova] Creating event network-vif-plugged:230a6a60-1da3-425e-8ff1-35512f5f96c2 for instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e on hv-cinder-84460 Jul 01 19:53:34.406612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-e658262d-2a8f-4e5c-96e6-5b0baa5eb1aa req-8ce4ea55-845d-492d-8c0f-a7bd77575451 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060098 Jul 01 19:53:34.407326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 41/83] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:34.413161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:34.425075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7ebf2d7f-4a8e-41b3-8b56-2c4f0a234301 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1314 microversion: 2.1 time: 0.286381 Jul 01 19:53:34.430654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 43/84] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:34 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1314 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:34.512455 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:34.513402 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:34.523476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.525161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.526970 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.534348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.737515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:34.738384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:34.756829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.758976 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.759805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:34.760236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:34.868791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:34.881183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-91b1f3d1-28ae-4245-8fb7-b14ab0792da4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1321 microversion: 2.1 time: 0.373752 Jul 01 19:53:34.881857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 42/85] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:34 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1321 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:35.177762 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:35.191298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-66d5807a-6710-4278-89bb-a5982e8f54c3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.458938 Jul 01 19:53:35.192472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 44/86] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:34 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:35.442772 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:35.443615 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:35.456909 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:35.457364 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:35.463346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:35.464223 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:35.604273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-0221cb0d-de14-41e8-8cf6-d4ab5b075712 req-31e2d3b6-ace6-42e6-bb03-6fff551fce7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:35.624445 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-0221cb0d-de14-41e8-8cf6-d4ab5b075712 req-31e2d3b6-ace6-42e6-bb03-6fff551fce7f service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:35.625262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-0221cb0d-de14-41e8-8cf6-d4ab5b075712 req-31e2d3b6-ace6-42e6-bb03-6fff551fce7f service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:35.654199 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-0221cb0d-de14-41e8-8cf6-d4ab5b075712 req-31e2d3b6-ace6-42e6-bb03-6fff551fce7f service nova] Creating event network-changed:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:53:35.667730 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-0221cb0d-de14-41e8-8cf6-d4ab5b075712 req-31e2d3b6-ace6-42e6-bb03-6fff551fce7f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067616 Jul 01 19:53:35.671046 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 45/87] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:35.877144 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:35.882295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:35.889175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f326cdd0-753a-44a7-8a3b-0aacb0df627e tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1501 microversion: 2.1 time: 0.450196 Jul 01 19:53:35.903509 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:35.904352 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:35.909832 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 43/88] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:35 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1501 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:35.956879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:35.957884 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:35.959907 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:35.963029 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:36.213968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:36.214846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:36.221138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:36.228347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:36.229490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:36.230154 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:36.471728 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:36.496896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6173ba6f-3a21-47f1-831c-1d7744c3f69d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1515 microversion: 2.1 time: 0.601245 Jul 01 19:53:36.499165 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 46/89] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:35 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1515 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:36.531493 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:36.537656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:36.563058 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:36.566051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:36.577990 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:36.578875 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:36.677534 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lazy-loading 'flavor' on Instance uuid a68aa76c-bae5-43da-9f08-50f825938444 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:53:36.733770 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:36.746524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8aa1c812-ea6d-4cc6-8526-de30d0dbe38b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1363 microversion: 2.1 time: 0.542023 Jul 01 19:53:36.747480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 44/90] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:36 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1363 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:36.863320 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=100 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:37.016556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1ad019c4-a428-4f57-bd84-e65b969772a1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444/action" status: 200 len: 32 microversion: 2.1 time: 0.500452 Jul 01 19:53:37.022792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 47/91] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:53:36 2022] POST /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444/action => generated 32 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:53:37.028611 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:37.029353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:37.043720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:37.044167 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:37.045997 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:37.046616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:37.407197 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:37.421215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5127582b-659a-47ee-b57e-f251f06b818c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.397678 Jul 01 19:53:37.432619 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 45/92] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:37 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:37.768943 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:37.770603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:37.795113 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:37.798365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:37.800723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:37.801897 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:37.949120 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1b7897a-45b4-4ec3-ba36-b328066b460e"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:37.951059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:37.964660 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:37.966143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:37.967165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:37.969265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:38.481911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:38.495597 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b2acfa14-b731-4129-9305-0e9cbcb69828 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1549 microversion: 2.1 time: 0.734615 Jul 01 19:53:38.496739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 48/93] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:37 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1549 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:38.515837 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:38.516637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:38.522826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:38.524182 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:38.525021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:38.525632 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:38.558655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fdbdad43-d2c7-4bc0-9a61-dfe20b7acd27 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "POST /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.621682 Jul 01 19:53:38.561853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 46/94] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:53:37 2022] POST /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:38.616711 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:38.619769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:38.637876 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:38.638708 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:38.639960 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:38.640785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:38.768204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3759532c-b5b2-4192-828d-51ff204f4892 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.204266 Jul 01 19:53:38.768992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 47/95] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 19:53:38 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:38.816106 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:38.827872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2a2e13f8-4822-46e0-8918-2f94e6055a18 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.328924 Jul 01 19:53:38.829188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 49/96] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:38 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:39.495634 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1850816083", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "networks": [{"uuid": "0f950f12-4f8f-441b-841d-975178800bd6"}]}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:39.550529 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] validate_networks() for [('0f950f12-4f8f-441b-841d-975178800bd6', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:53:39.847827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:39.848890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:39.856321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:39.857390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:39.858973 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:39.859587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:40.021964 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:53:40.022386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:53:40.022856 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:53:40.023262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:53:40.024238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:53:40.033640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:40.034083 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:40.035078 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:40.035691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:40.053706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Getting quotas for project 387f55f94c784e988f8c0e240f2dc1c6. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:53:40.058538 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Getting quotas for user e8bbb1244dca43f8947835d01b69da0b and project 387f55f94c784e988f8c0e240f2dc1c6. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:53:40.070138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:53:40.073491 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:53:40.085934 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:40.095499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cfe0890a-7f76-4507-9239-faaf6bb4ce73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.253703 Jul 01 19:53:40.105028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 50/97] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:39 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:40.106119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-b2ad1e18-0b4d-4424-b846-3640ce6f020c req-96667f78-0f8f-4957-9185-d00683c6ee97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1a80874-00ef-4d4b-8ef0-7a604ed7458e", "tag": "230a6a60-1da3-425e-8ff1-35512f5f96c2"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:40.122689 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-b2ad1e18-0b4d-4424-b846-3640ce6f020c req-96667f78-0f8f-4957-9185-d00683c6ee97 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:40.123132 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-b2ad1e18-0b4d-4424-b846-3640ce6f020c req-96667f78-0f8f-4957-9185-d00683c6ee97 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:40.141828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-318c8bc4-b8b8-46bb-8231-39a73a15163b tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651497 Jul 01 19:53:40.142826 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 48/98] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:53:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:53:40.153689 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cca35002-c4b6-4315-bb26-2b4ae7e56486 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:40.154338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-b2ad1e18-0b4d-4424-b846-3640ce6f020c req-96667f78-0f8f-4957-9185-d00683c6ee97 service nova] Creating event network-changed:230a6a60-1da3-425e-8ff1-35512f5f96c2 for instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e on hv-cinder-84460 Jul 01 19:53:40.154724 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-cca35002-c4b6-4315-bb26-2b4ae7e56486 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:40.159527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-b2ad1e18-0b4d-4424-b846-3640ce6f020c req-96667f78-0f8f-4957-9185-d00683c6ee97 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062318 Jul 01 19:53:40.163708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 51/99] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:40.221974 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-cca35002-c4b6-4315-bb26-2b4ae7e56486 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:40.236231 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cca35002-c4b6-4315-bb26-2b4ae7e56486 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1214 microversion: 2.1 time: 0.087319 Jul 01 19:53:40.236970 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 49/100] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:40 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:41.112938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:41.113756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:41.119923 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:41.120365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:41.121146 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:41.121603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:41.254731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:41.255344 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:41.262765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:41.263204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:41.263957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:41.264390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:41.267731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:41.276390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6529b98b-faaf-4d54-91c4-f7dea954b310 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.167662 Jul 01 19:53:41.276955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 52/101] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:41 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:41.324526 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:41.331846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7f5baac6-9cac-497a-957a-19d0c9239380 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1218 microversion: 2.1 time: 0.080976 Jul 01 19:53:41.332410 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 50/102] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:41 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:42.294285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:42.295206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:42.300979 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:42.301419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:42.302209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:42.302637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:42.348685 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:42.349401 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:42.356714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:42.357237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:42.358107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:42.358617 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:42.450721 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:42.462472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-19b43adb-59ca-4ca0-8bd4-3d8c66edf0a3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1218 microversion: 2.1 time: 0.117566 Jul 01 19:53:42.463205 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 51/103] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:42 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:42.571767 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:42.579714 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c864f7b6-d37a-4092-8264-92a2182c750b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.289222 Jul 01 19:53:42.580300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 53/104] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:42 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:43.478501 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:43.479129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:43.486054 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:43.486597 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:43.487656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:43.488234 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:43.558441 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:43.566148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b8a28314-3242-4612-b9ec-57bd7b3c58a0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1272 microversion: 2.1 time: 0.091594 Jul 01 19:53:43.566720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 52/105] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:43 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1272 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:43.596484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:43.597135 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:43.604248 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:43.604697 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:43.605458 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:43.605932 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:43.747883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:43.756728 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-74750d25-dcd8-4513-a6c7-6a9b4a19108d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.163955 Jul 01 19:53:43.757815 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 54/106] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:43 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:44.583894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:44.584516 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:44.591840 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:44.592288 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:44.593049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:44.593483 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:44.653852 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:44.661099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-16b58ffe-4bde-442b-991c-6586a2071a11 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1272 microversion: 2.1 time: 0.081297 Jul 01 19:53:44.661688 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 53/107] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:44 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1272 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:44.774151 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:44.774752 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:44.781765 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:44.782298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:44.783158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:44.783662 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:44.917888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:44.925227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bfb701b3-063c-4737-b08c-f33a25b25477 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.154832 Jul 01 19:53:44.925832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 55/108] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:44 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:45.678097 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:45.678712 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:45.685331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:45.685813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:45.686575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:45.687040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:45.746417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:45.753716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a3ed0774-0c2c-43a0-965f-b9a4419c7609 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1272 microversion: 2.1 time: 0.079459 Jul 01 19:53:45.754273 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 54/109] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:45 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1272 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:45.942715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:45.943320 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:45.949346 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:45.949824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:45.950582 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:45.951015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:46.255264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:46.267347 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e7ef3a85-e4e1-47a3-a559-bb9ff574f093 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.328178 Jul 01 19:53:46.278484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 56/110] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:45 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:46.775204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:46.779616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:46.788454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:46.789121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:46.790033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:46.790530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:47.107476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:47.118081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7581f9fa-a5bb-4b5a-aa62-78ba93e92ef0 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.348813 Jul 01 19:53:47.129603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 55/111] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:46 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:47.284095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:47.285275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:47.291771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:47.292419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:47.293325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:47.294006 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:47.542363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:47.550275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-334ef034-e735-438c-97c7-774852fe686c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.269872 Jul 01 19:53:47.552529 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 57/112] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:47 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:47.726050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-9613f459-7d21-4623-8a63-cfaffb4239a6 req-b8907332-f479-4e50-8cfe-6f898b25c5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e19f452-0c5c-4b3e-8243-ac925a3335ac", "tag": "1aa0c0d6-9243-44ae-82a8-1412617661fe"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:47.739515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9613f459-7d21-4623-8a63-cfaffb4239a6 req-b8907332-f479-4e50-8cfe-6f898b25c5c2 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:47.744669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9613f459-7d21-4623-8a63-cfaffb4239a6 req-b8907332-f479-4e50-8cfe-6f898b25c5c2 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:47.767785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-9613f459-7d21-4623-8a63-cfaffb4239a6 req-b8907332-f479-4e50-8cfe-6f898b25c5c2 service nova] Creating event network-changed:1aa0c0d6-9243-44ae-82a8-1412617661fe for instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac on hv-cinder-84460 Jul 01 19:53:47.785180 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-9613f459-7d21-4623-8a63-cfaffb4239a6 req-b8907332-f479-4e50-8cfe-6f898b25c5c2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074971 Jul 01 19:53:47.786480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 56/113] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:48.134826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:48.135436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:48.144221 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:48.145139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:48.146134 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:48.146576 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:48.309719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:48.317985 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d8c41312-042f-4be4-a8b8-f3dc1044cb43 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.186883 Jul 01 19:53:48.318730 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 58/114] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:48 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:48.571841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:48.572532 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:48.578759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:48.579195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:48.579940 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:48.580708 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:48.714723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:48.722317 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-589ff74b-b942-4cea-825d-88183911ecbe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.156194 Jul 01 19:53:48.722928 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 57/115] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:48 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:49.336059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:49.337336 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:49.344013 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:49.344537 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:49.345359 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:49.345886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:49.714027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:49.727342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-694373f7-972e-447b-bb40-b1dbc82e8cde tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.396135 Jul 01 19:53:49.728057 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 59/116] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:49 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:49.740752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:49.741352 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:49.750755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:49.751978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:49.752701 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:49.753226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:50.044984 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:50.144532 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:50.161045 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-25d40b13-cc54-46c8-add8-2e3115152960 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.425041 Jul 01 19:53:50.162569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 58/117] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:49 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:50.522544 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:50.524603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:50.534850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:50.535669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:50.536657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:50.537876 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:50.577084 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:53:50.712012 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8433ec9b-26f8-4b39-afc9-d1a44ac9a853 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 204 len: 0 microversion: 2.1 time: 0.190369 Jul 01 19:53:50.712012 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 60/118] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:53:50 2022] DELETE /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:53:50.719696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:50.720306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:50.723168 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=8 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:50.727233 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:50.727736 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:50.728753 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:50.730286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:50.746774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:50.747645 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:50.757382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:50.758437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:50.759523 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:50.760701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:51.071737 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:51.073626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:51.077783 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:51.083186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-59b2b1b9-4aa2-4265-9c9c-85eb8626dede tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.342463 Jul 01 19:53:51.089038 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 61/119] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:50 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:51.101749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ddfaf595-e706-4dba-8005-24d94a24f972 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1553 microversion: 2.1 time: 0.385138 Jul 01 19:53:51.103419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 59/120] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:50 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1553 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:51.182306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:51.183378 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:51.195773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:51.196540 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:51.197872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:51.198527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:51.392424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:51.405056 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b7287983-035a-4708-9781-e2c6cc482255 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.228993 Jul 01 19:53:51.406673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 62/121] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:51 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:52.120040 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:52.121244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:52.129392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:52.143453 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:52.147424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:52.149241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:52.151095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:52.151095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:52.154580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:52.155197 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:52.156127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:52.156715 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:52.445920 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:52.461328 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4a83a294-ce5b-4315-8375-c914add988e3 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.358155 Jul 01 19:53:52.462338 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 60/122] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:52 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:52.468615 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:52.469036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:52.477278 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:52.478640 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-db763a6b-9672-49c2-bf65-0edc2d1d749a tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1553 microversion: 2.1 time: 0.362823 Jul 01 19:53:52.479167 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 63/123] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:52 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1553 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:52.485367 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:52.486156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:52.487422 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:52.488070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:52.638393 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:52.644455 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:52.646994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-34191966-332d-46eb-9e01-d1720d5dab7a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.183113 Jul 01 19:53:52.650479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 61/124] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:52 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:53.481297 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:53.483754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:53.488811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:53.498589 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:53.499249 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:53.517098 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:53.517426 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:53.518693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:53.519711 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:53.522272 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:53.523541 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:53.524637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:53.526346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:53.962236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:53.975116 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-05edc4ca-6d85-462c-8a6e-f4cecfa5dde7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.500141 Jul 01 19:53:53.978778 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 64/125] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:53 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:53.989045 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:53.990072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:54.010473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:54.014658 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:54.015112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:54.015903 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:54.016341 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:54.025973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-974cd707-4f03-4d4f-8b60-e3d4695bbce5 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1553 microversion: 2.1 time: 0.534152 Jul 01 19:53:54.041419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 62/126] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:53 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1553 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:54.392341 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:54.408280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-04e83e06-1bde-4b57-acbf-e94272e14597 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.428216 Jul 01 19:53:54.409173 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 65/127] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:53 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:54.996242 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:54.998623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:55.011722 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:53:55.013911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:55.014604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:55.015632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:55.016235 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:55.048772 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:55.051731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:55.067787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:55.072130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:55.075912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:55.076577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:55.379893 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:55.409233 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dffdd23c-f1d9-4dc3-b51c-c1265365a74e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.411167 Jul 01 19:53:55.409832 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 63/128] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:54 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:55.430040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:55.430653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:55.446262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:55.446716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:55.447491 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:55.455616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:55.737879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:55.765483 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-65bfa44c-0d4d-4969-8430-ff54691f0b43 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1553 microversion: 2.1 time: 0.719627 Jul 01 19:53:55.767598 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 66/129] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:55 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1553 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:55.813740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:55.858342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a01fc1d4-f103-4eab-b7e7-2531e3c795ff tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.432250 Jul 01 19:53:55.872143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 64/130] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:55 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:56.091779 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-d7e4f9bd-571d-4e7d-ba97-9239c53acfa1 req-4ad92f64-d9b6-46f8-93fc-5f03a6309526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f809d6-179b-4d3c-a955-d8aa4ad1ee38", "name": "network-vif-deleted", "tag": "e95ca826-2651-40ec-803c-c0c94b2615d4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:56.109143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-d7e4f9bd-571d-4e7d-ba97-9239c53acfa1 req-4ad92f64-d9b6-46f8-93fc-5f03a6309526 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.109910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-d7e4f9bd-571d-4e7d-ba97-9239c53acfa1 req-4ad92f64-d9b6-46f8-93fc-5f03a6309526 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.142125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-d7e4f9bd-571d-4e7d-ba97-9239c53acfa1 req-4ad92f64-d9b6-46f8-93fc-5f03a6309526 service nova] Creating event network-vif-deleted:e95ca826-2651-40ec-803c-c0c94b2615d4 for instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 on hv-cinder-84460 Jul 01 19:53:56.150391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-d7e4f9bd-571d-4e7d-ba97-9239c53acfa1 req-4ad92f64-d9b6-46f8-93fc-5f03a6309526 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063052 Jul 01 19:53:56.151569 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 67/131] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:56.432205 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:56.433037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:56.441300 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.441870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.442700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.443217 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.654180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-b49286e3-e69e-4a84-b8da-2b70bd088e41 req-62699e05-6e5a-4d5a-8be2-cc441cb49628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e19f452-0c5c-4b3e-8243-ac925a3335ac", "name": "network-vif-plugged", "status": "completed", "tag": "1aa0c0d6-9243-44ae-82a8-1412617661fe"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:53:56.672253 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-b49286e3-e69e-4a84-b8da-2b70bd088e41 req-62699e05-6e5a-4d5a-8be2-cc441cb49628 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.674626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-b49286e3-e69e-4a84-b8da-2b70bd088e41 req-62699e05-6e5a-4d5a-8be2-cc441cb49628 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.714419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-b49286e3-e69e-4a84-b8da-2b70bd088e41 req-62699e05-6e5a-4d5a-8be2-cc441cb49628 service nova] Creating event network-vif-plugged:1aa0c0d6-9243-44ae-82a8-1412617661fe for instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac on hv-cinder-84460 Jul 01 19:53:56.731944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-b49286e3-e69e-4a84-b8da-2b70bd088e41 req-62699e05-6e5a-4d5a-8be2-cc441cb49628 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082377 Jul 01 19:53:56.734777 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 68/132] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:53:56.787805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:56.789460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:56.801932 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.803129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.805245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.806017 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.817843 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:56.829410 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ae430e52-7640-4592-93f3-872c192da45e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.401129 Jul 01 19:53:56.830529 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 65/133] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:56 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:56.878347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:56.879501 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:56.891892 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.893017 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.894364 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:56.907346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:56.915925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71647f9f93ec4235818d27640058d25c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2347fd8e4a1740fdb98218aa30c150e0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:56.928274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c3fe375b-bc43-4a70-b378-fe298d2335a1 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 200 len: 1345 microversion: 2.1 time: 0.149663 Jul 01 19:53:56.931747 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 69/134] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:56 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 1345 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:57.098388 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:57.107006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5432edbf-67d0-411b-b0fb-ca2b9175af73 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.232975 Jul 01 19:53:57.113696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 66/135] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:56 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:53:57.847319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:57.848103 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:57.884592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:57.885039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:57.885854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:57.886330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:57.950894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:57.951893 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:57.962535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:57.963263 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:57.964268 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:57.964817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:57.979291 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] HTTP exception thrown: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Request method failure captured: Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 HTTP/1.1 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CbyNH79J25BlZkNcOeKhdvo0xJKuEdixquxjIblJgYqblnl4JZAfVK_wNtcUAxwaKWY2YDgXPFnCSPf5a8ZMR3Yt9dfu_Xu_cT-sMSzmjm2NxDAcjDPIsIgFi3ffsGLkYeICMO7-Jd1mVock9GGCyhv4AcKje4QvSmcWCtdlF9654 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:53:57.992608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 71647f9f93ec4235818d27640058d25c Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:57.994115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'c7f809d6-179b-4d3c-a955-d8aa4ad1ee38'} Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:53:57.994923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:57.996438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:57.998001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Returning 404 to user: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:53:57.998001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-056ca82a-9f16-4aca-b960-5d6fae2563c4 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 404 len: 111 microversion: 2.1 time: 0.052263 Jul 01 19:53:57.999106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 67/136] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:57 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:53:58.120180 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:58.121654 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:58.129420 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:58.130133 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:58.131074 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:58.131660 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:58.150563 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:58.151152 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] HTTP exception thrown: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Request method failure captured: Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38/os-volume_attachments HTTP/1.1 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CbyNH79J25BlZkNcOeKhdvo0xJKuEdixquxjIblJgYqblnl4JZAfVK_wNtcUAxwaKWY2YDgXPFnCSPf5a8ZMR3Yt9dfu_Xu_cT-sMSzmjm2NxDAcjDPIsIgFi3ffsGLkYeICMO7-Jd1mVock9GGCyhv4AcKje4QvSmcWCtdlF9654 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:53:58.153134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 71647f9f93ec4235818d27640058d25c Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:58.154623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'server_id': 'c7f809d6-179b-4d3c-a955-d8aa4ad1ee38'} Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:53:58.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:53:58.156709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:53:58.159779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Returning 404 to user: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:53:58.160797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e8548878-8a0e-4efc-b20d-c5f9fc7a3391 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044832 Jul 01 19:53:58.161624 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-50c6cee6-377c-4648-873f-a1c0ad8aa268 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.318156 Jul 01 19:53:58.162065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 68/137] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:53:58 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:53:58.174144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 70/138] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:57 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:58.175604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:58.176216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:58.182892 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:58.183330 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:58.184089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:58.184522 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:58.369487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:58.377051 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c01bd1de-fc51-4557-b3d0-a0d0b211f1d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.210239 Jul 01 19:53:58.377636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 69/139] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:58 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:59.181314 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:59.181962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:59.188860 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:59.189427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:59.190377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:59.191189 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:59.402965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:53:59.403589 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:53:59.412181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:59.412181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:59.418908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:53:59.419601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:53:59.607652 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:59.618256 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d3d1f327-8734-44cf-b41e-43d8912884ea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.443288 Jul 01 19:53:59.619410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 71/140] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:59 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:53:59.772370 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:53:59.780835 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ff7651a0-4f33-4e0f-8b49-e78610d80316 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.390146 Jul 01 19:53:59.796290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 70/141] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:53:59 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:00.638626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:00.639843 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:00.649363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:00.650105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:00.650918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:00.651430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:00.803145 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:00.805211 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:00.815146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:00.816098 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:00.817672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:00.818307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:00.930808 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:00.946286 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ac9eb212-9b39-4bf0-9df3-2b940668de25 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.314244 Jul 01 19:54:00.955857 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 72/142] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:00 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:01.119494 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:01.144813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-15c46c29-7479-42cb-981b-2e62f9f7d296 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.345674 Jul 01 19:54:01.149883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 71/143] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:00 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:01.684910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:01.686024 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:01.696558 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.697787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.700760 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.701601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.744330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] HTTP exception thrown: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Request method failure captured: Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 HTTP/1.1 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CbyNH79J25BlZkNcOeKhdvo0xJKuEdixquxjIblJgYqblnl4JZAfVK_wNtcUAxwaKWY2YDgXPFnCSPf5a8ZMR3Yt9dfu_Xu_cT-sMSzmjm2NxDAcjDPIsIgFi3ffsGLkYeICMO7-Jd1mVock9GGCyhv4AcKje4QvSmcWCtdlF9654 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:54:01.761515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 71647f9f93ec4235818d27640058d25c Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.763001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'c7f809d6-179b-4d3c-a955-d8aa4ad1ee38'} Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:54:01.763786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.765008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.766450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Returning 404 to user: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:54:01.767199 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2ac4a3ca-f2a3-42ca-97a5-ae0b442095b8 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 404 len: 111 microversion: 2.1 time: 0.092200 Jul 01 19:54:01.771600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 73/144] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:54:01 2022] DELETE /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:54:01.777301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:01.777939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] [instance: c7f809d6-179b-4d3c-a955-d8aa4ad1ee38] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:01.796049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.796518 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.797431 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.799381 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.862146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] HTTP exception thrown: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Request method failure captured: Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 HTTP/1.1 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CbyNH79J25BlZkNcOeKhdvo0xJKuEdixquxjIblJgYqblnl4JZAfVK_wNtcUAxwaKWY2YDgXPFnCSPf5a8ZMR3Yt9dfu_Xu_cT-sMSzmjm2NxDAcjDPIsIgFi3ffsGLkYeICMO7-Jd1mVock9GGCyhv4AcKje4QvSmcWCtdlF9654 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:54:01.872837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2347fd8e4a1740fdb98218aa30c150e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 2347fd8e4a1740fdb98218aa30c150e0 Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-DeleteServersTestJSON-1960359171 Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 71647f9f93ec4235818d27640058d25c Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-DeleteServersTestJSON-1960359171-project Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.874166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'c7f809d6-179b-4d3c-a955-d8aa4ad1ee38'} Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:54:01.874807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. Jul 01 19:54:01.875819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:01.882467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] Returning 404 to user: Instance c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:54:01.886435 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8cf24d19-c531-45dc-aa35-63f844f81602 tempest-DeleteServersTestJSON-1960359171 tempest-DeleteServersTestJSON-1960359171-project] 10.222.0.66 "GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38" status: 404 len: 111 microversion: 2.1 time: 0.114404 Jul 01 19:54:01.888002 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 72/145] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:01 2022] GET /compute/v2.1/servers/c7f809d6-179b-4d3c-a955-d8aa4ad1ee38 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:54:01.968570 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:01.970092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:01.991687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.992852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:01.995704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:01.996332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:02.171725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:02.172553 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:02.187235 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:02.187677 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:02.192301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:02.192752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:02.773407 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:02.791218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c6dfa99d-adca-4af2-bdd8-b874e7897afd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1314 microversion: 2.1 time: 0.827491 Jul 01 19:54:02.791853 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 74/146] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:01 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1314 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:02.828853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:02.852796 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0e826fbb-3ba0-492c-a3fc-be3ba09c8217 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.691109 Jul 01 19:54:02.853444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 73/147] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:02 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:03.808697 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:03.809325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:03.820855 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:03.821310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:03.822184 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:03.831523 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:03.870389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:03.870996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:03.889034 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:03.889467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:03.890978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:03.891426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:04.139210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:04.150215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3bfddca5-f279-483e-8e30-e1adc3eb6bd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.281963 Jul 01 19:54:04.153403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 74/148] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:03 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:04.176497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:04.189391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cd4ad72e-9732-4554-b077-a0f529a7958d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1499 microversion: 2.1 time: 0.384383 Jul 01 19:54:04.193164 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 75/149] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:03 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1499 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:04.589760 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-665d64d6-241a-486a-8bee-48edc9459c74 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Action: 'create', calling method: .version_select at 0x7fa00c1a4a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-370955949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL31tlVER3S+ff5lXY8q8ZXZNiwW+F47UN9o4BvKI0bZDurzRARRvGcdoT2NSiiznA1JpVDii6zp6GAifBYFOexmI9JMPyVyen2vRR/jVRYctrEzzJ4gGcEQ3JzDTsfQdg=="}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:04.611670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-665d64d6-241a-486a-8bee-48edc9459c74 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Getting quotas for project 669587fe364c4741b489449451f2294c. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:54:04.617620 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-665d64d6-241a-486a-8bee-48edc9459c74 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Getting quotas for user c815ea64d44a48d89a2f5ff10f3f9ee8 and project 669587fe364c4741b489449451f2294c. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:54:04.642785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-665d64d6-241a-486a-8bee-48edc9459c74 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.485907 Jul 01 19:54:04.644353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 75/150] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:54:04 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:04.875056 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:04.876880 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:04.888461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:04.889177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:04.890344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:04.890981 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:04.926912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:54:05.079869 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-506c1456-4ff6-4b3b-9ad0-cf34f88edf9f tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "DELETE /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 204 len: 0 microversion: 2.1 time: 0.207887 Jul 01 19:54:05.080533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 76/151] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:54:04 2022] DELETE /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:54:05.090378 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:05.092226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:05.109343 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:05.121182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:05.122445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:05.123055 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:05.175154 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:05.175883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:05.187423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:05.187881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:05.188662 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:05.192855 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:05.617965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:05.629988 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cb0ed7ee-0938-4f59-8a0b-5f4760ff1fbd tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1505 microversion: 2.1 time: 0.544716 Jul 01 19:54:05.634015 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 76/152] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:05 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1505 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:05.671161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:05.680448 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9ad8666a-1d38-42cd-80c7-259cacc9daed tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.512570 Jul 01 19:54:05.701393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 77/153] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:05 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:06.651931 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:06.653452 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:06.668779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:06.669886 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:06.670692 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:06.671238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:06.701329 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:06.702500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:06.714806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:06.715864 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:06.716678 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:06.717128 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:07.322793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:07.327491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:07.335370 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-934b341f-1f83-4f63-800b-603d1cf996fe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.637900 Jul 01 19:54:07.345691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 78/154] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:06 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:07.465106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:07.489117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-52337a5f-fe31-4781-b0b7-548c35164a58 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1505 microversion: 2.1 time: 0.843847 Jul 01 19:54:07.497976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 77/155] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:06 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1505 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:08.355833 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:08.357547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:08.368603 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.369051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.369850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.370291 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.513327 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-e91f09ae-7834-4e6c-8d24-c591ca8f5940 req-4fc24936-4dd9-45d7-9003-4c9f7d769828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e19f452-0c5c-4b3e-8243-ac925a3335ac", "name": "network-vif-deleted", "tag": "1aa0c0d6-9243-44ae-82a8-1412617661fe"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:08.541278 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-e91f09ae-7834-4e6c-8d24-c591ca8f5940 req-4fc24936-4dd9-45d7-9003-4c9f7d769828 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.547921 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-e91f09ae-7834-4e6c-8d24-c591ca8f5940 req-4fc24936-4dd9-45d7-9003-4c9f7d769828 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.574071 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-e91f09ae-7834-4e6c-8d24-c591ca8f5940 req-4fc24936-4dd9-45d7-9003-4c9f7d769828 service nova] Creating event network-vif-deleted:1aa0c0d6-9243-44ae-82a8-1412617661fe for instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac on hv-cinder-84460 Jul 01 19:54:08.596139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-e91f09ae-7834-4e6c-8d24-c591ca8f5940 req-4fc24936-4dd9-45d7-9003-4c9f7d769828 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073020 Jul 01 19:54:08.596821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 78/156] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:08.617799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:08.618761 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:08.634565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.636016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.637003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.641318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.711306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:08.721269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9d633405-0699-417a-af3a-515ea111e177 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.372072 Jul 01 19:54:08.721530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:08.721944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 79/157] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:08 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:08.725965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:08.726984 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lazy-loading 'fault' on Instance uuid 0e19f452-0c5c-4b3e-8243-ac925a3335ac {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:54:08.788539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:08.796948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-13f66039-5c74-4c55-adfe-23cc211e52e9 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 200 len: 1304 microversion: 2.1 time: 0.192831 Jul 01 19:54:08.797555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 79/158] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:08 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 1304 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:09.744547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:09.746230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:09.757624 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:09.758873 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:09.759910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:09.761046 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:09.821959 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:09.822574 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: 0e19f452-0c5c-4b3e-8243-ac925a3335ac] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:09.833800 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:09.834661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:09.835882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:09.836593 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:09.857618 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] HTTP exception thrown: Instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac could not be found. Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Request method failure captured: Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac HTTP/1.1 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1DAomrMaaPmsXybj0BCHhkUbVajpyQdIY_va_mISeEAT1cxM1zt8N1yOFxIhMZn8dbBcNJH8A05kLFLDCXv_6Oh4Z4kvbBCk7QjSW1VcAhEPnTz22dLsi7C7uYoHKVqqRlvjZXL-Hlpbbx2PNTp3oUyBA_i_9hc-Nui9J2SV3sxAU8 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 387f55f94c784e988f8c0e240f2dc1c6 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesActionsTest-1686412444 Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:54:09.861236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesActionsTest-1686412444 Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 387f55f94c784e988f8c0e240f2dc1c6 Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesActionsTest-1686412444 Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesActionsTest-1686412444-project Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: e8bbb1244dca43f8947835d01b69da0b Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesActionsTest-1686412444-project Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac could not be found. Jul 01 19:54:09.862667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '0e19f452-0c5c-4b3e-8243-ac925a3335ac'} Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac could not be found. Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:54:09.863524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac could not be found. Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac could not be found. Jul 01 19:54:09.864808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:54:09.870611 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Returning 404 to user: Instance 0e19f452-0c5c-4b3e-8243-ac925a3335ac could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:54:09.871583 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dcb6ffb1-fa95-4335-b5ca-2f1777b19c6c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac" status: 404 len: 111 microversion: 2.1 time: 0.056210 Jul 01 19:54:09.874150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 80/159] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:09 2022] GET /compute/v2.1/servers/0e19f452-0c5c-4b3e-8243-ac925a3335ac => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:54:09.922292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:09.931453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-68ee4c02-f9a5-4b5a-b89e-567a18a0579e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.196433 Jul 01 19:54:09.932097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 80/160] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:09 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:10.053543 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-954142330", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "networks": [{"uuid": "0f950f12-4f8f-441b-841d-975178800bd6"}]}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:10.115850 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] validate_networks() for [('0f950f12-4f8f-441b-841d-975178800bd6', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:54:10.565727 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:54:10.566128 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:54:10.566922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:54:10.567442 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:54:10.567933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:54:10.578899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:10.579351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:10.580125 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:10.580733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:10.603882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Getting quotas for project 387f55f94c784e988f8c0e240f2dc1c6. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:54:10.609854 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Getting quotas for user e8bbb1244dca43f8947835d01b69da0b and project 387f55f94c784e988f8c0e240f2dc1c6. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:54:10.622296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:54:10.625006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:54:10.680739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-99cf21e7-3f1d-4e37-a50c-f677eacb7cf5 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632732 Jul 01 19:54:10.685733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 81/161] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:54:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 19:54:10.698317 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a9b4d645-9dc4-426b-865c-4ac94fab16fa tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:10.699810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a9b4d645-9dc4-426b-865c-4ac94fab16fa tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:10.784518 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a9b4d645-9dc4-426b-865c-4ac94fab16fa tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:10.792499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a9b4d645-9dc4-426b-865c-4ac94fab16fa tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1213 microversion: 2.1 time: 0.104149 Jul 01 19:54:10.793657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 81/162] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:10 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:10.952599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:10.953468 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:10.962142 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:10.962744 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:10.963764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:10.964319 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:11.158395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:11.167670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f2792a34-f3a3-4070-a05a-bbab2323bc5e tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.222031 Jul 01 19:54:11.183650 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 82/163] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:10 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:11.809758 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:11.810372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:11.817700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:11.818153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:11.819776 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:11.820616 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:11.890625 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:11.899449 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0721d6c3-bf90-4c67-b44c-925f8add42d7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1265 microversion: 2.1 time: 0.093669 Jul 01 19:54:11.900020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 82/164] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:11 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:12.186270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:12.187846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:12.195370 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.196064 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:12.197525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.198084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:12.211865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:12.360966 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:12.370240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e72f23a1-4eb4-4a7e-9439-e6669f59ff98 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.188709 Jul 01 19:54:12.370813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 83/165] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:12 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:12.917355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:12.918568 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:12.926303 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.936958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:12.937820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:12.938274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:13.063675 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:13.072371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c668b764-4203-4aa8-8568-51fa49d02aea tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1283 microversion: 2.1 time: 0.159600 Jul 01 19:54:13.073065 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 83/166] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:12 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1283 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:13.387109 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:13.388347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:13.395025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:13.395517 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:13.396511 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:13.397959 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:13.585613 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:13.594343 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-82482abb-c61f-4783-a192-2167ca88199d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.211067 Jul 01 19:54:13.595178 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 84/167] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:13 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:14.090609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:14.093098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:14.103160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.104122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.109866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.110856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.300355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:14.308809 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7ee6caf9-a5d2-4bc0-9f22-a0ea446d52a2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.223380 Jul 01 19:54:14.309382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 84/168] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:14 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:14.618134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:14.620621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:14.629295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.629984 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.630848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:14.631911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:14.829342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:14.839216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-827c5fa2-1798-492e-93fc-ed63efc42e53 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1521 microversion: 2.1 time: 0.228214 Jul 01 19:54:14.840602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 85/169] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:14 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:15.326602 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:15.327264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:15.336789 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:15.337238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:15.338037 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:15.338465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:15.465300 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-fdc798ed-b101-4f69-aeae-990568ed530f req-e9267b25-9f46-4ab4-b797-bc7496ac9f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5191a68-0a14-4909-bb07-841c6c8f293e", "tag": "36d752c6-22ce-4461-9450-85e78a6e2d45"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:15.484532 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-fdc798ed-b101-4f69-aeae-990568ed530f req-e9267b25-9f46-4ab4-b797-bc7496ac9f48 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:15.485469 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-fdc798ed-b101-4f69-aeae-990568ed530f req-e9267b25-9f46-4ab4-b797-bc7496ac9f48 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:15.527211 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-fdc798ed-b101-4f69-aeae-990568ed530f req-e9267b25-9f46-4ab4-b797-bc7496ac9f48 service nova] Creating event network-changed:36d752c6-22ce-4461-9450-85e78a6e2d45 for instance e5191a68-0a14-4909-bb07-841c6c8f293e on hv-cinder-84460 Jul 01 19:54:15.533050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-fdc798ed-b101-4f69-aeae-990568ed530f req-e9267b25-9f46-4ab4-b797-bc7496ac9f48 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073843 Jul 01 19:54:15.534764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 86/170] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:15.566126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:15.577620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-62b5242a-5030-43c4-8e5d-4d1cb7a1c3ae tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.253440 Jul 01 19:54:15.583023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 85/171] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:15 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:15.857998 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:15.859377 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:15.866805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:15.867428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:15.868271 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:15.868723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:16.049008 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:16.057906 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8335dc87-764f-451e-a9e1-ebb195a3123f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1501 microversion: 2.1 time: 0.204462 Jul 01 19:54:16.058490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 87/172] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:15 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1501 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:16.073955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:16.074649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:16.080679 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:16.081203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:16.082000 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:16.082438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:16.221094 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:16.230369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-75af6f08-8d0d-4292-a401-00ea3a0c634c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1516 microversion: 2.1 time: 0.160098 Jul 01 19:54:16.230841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 86/173] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:16 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:16.594879 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:16.595521 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:16.602328 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:16.602775 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:16.603546 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:16.603976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:16.744572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:16.751958 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0148b8cb-d40f-42b5-b811-ada81c5dca99 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.160906 Jul 01 19:54:16.753091 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 88/174] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:16 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:17.593643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:17.594636 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:17.602074 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:17.602515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:17.603262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:17.603690 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:17.627240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lazy-loading 'flavor' on Instance uuid e1148781-931f-4460-a8e3-7f3654799ce7 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:54:17.697428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9149bcb4-6455-47fe-8cd6-5b064f51eb10 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/action" status: 200 len: 32 microversion: 2.1 time: 0.107552 Jul 01 19:54:17.698114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 87/175] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:54:17 2022] POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/action => generated 32 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:54:17.707032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:17.707642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:17.714323 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:17.714769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:17.715527 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:17.715982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:17.769115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:17.769842 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:17.776997 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:17.777434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:17.778211 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:17.778643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:17.890716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:17.898777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e662b97a-574a-4e9c-a331-a88be10c1f81 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.195543 Jul 01 19:54:17.899350 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 89/176] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:17 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:17.933405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:17.940885 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5b876b8f-7c16-4574-bae2-71f251eaf8db tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.175814 Jul 01 19:54:17.941447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 88/177] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:17 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:18.916971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:18.917572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:18.923989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:18.924426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:18.925166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:18.925614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:18.956948 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:18.957694 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:18.964410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:18.964931 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:18.965807 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:18.966333 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:19.101895 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:19.109764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-45e170bc-6c45-4af6-9a7d-0f12e2184b3f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.197423 Jul 01 19:54:19.110248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 90/178] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:18 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:19.135155 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:19.142489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-51d205da-93c9-4998-b12f-3326a8154e90 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.189319 Jul 01 19:54:19.143043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 89/179] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:18 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:20.127550 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:20.128163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:20.139191 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:20.139632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:20.140405 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:20.140858 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:20.161286 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:20.163475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:20.183434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:20.184798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:20.189925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:20.195747 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:20.446761 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:20.454365 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8cc6742b-a5f2-4be3-85a7-3bf42f8bf908 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.330600 Jul 01 19:54:20.454942 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 91/180] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:20 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:20.484511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:20.492400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3bfc7de8-b858-4987-a9fa-bde35c5fdd13 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.336115 Jul 01 19:54:20.493061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 90/181] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:20 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:21.415332 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-73f75366-af57-48ad-9d0a-83d4617e7b2e req-f69b7e52-c799-4b1a-8476-4ce33611214a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5191a68-0a14-4909-bb07-841c6c8f293e", "name": "network-vif-plugged", "status": "completed", "tag": "36d752c6-22ce-4461-9450-85e78a6e2d45"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:21.418860 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:21.419731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=10 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:21.426714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-73f75366-af57-48ad-9d0a-83d4617e7b2e req-f69b7e52-c799-4b1a-8476-4ce33611214a service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:21.427302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-73f75366-af57-48ad-9d0a-83d4617e7b2e req-f69b7e52-c799-4b1a-8476-4ce33611214a service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:21.440167 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-73f75366-af57-48ad-9d0a-83d4617e7b2e req-f69b7e52-c799-4b1a-8476-4ce33611214a service nova] Creating event network-vif-plugged:36d752c6-22ce-4461-9450-85e78a6e2d45 for instance e5191a68-0a14-4909-bb07-841c6c8f293e on hv-cinder-84460 Jul 01 19:54:21.445966 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-73f75366-af57-48ad-9d0a-83d4617e7b2e req-f69b7e52-c799-4b1a-8476-4ce33611214a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034565 Jul 01 19:54:21.446946 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 92/182] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:21.472338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:21.473552 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:21.480042 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:21.481673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:21.482066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:21.482859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:21.483340 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:21.516680 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:21.517461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:21.524580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:21.525002 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:21.525790 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:21.526220 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:21.716734 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:21.725950 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:21.727537 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c28550c7-b508-4b2d-aa25-2e94fba86aa7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.259056 Jul 01 19:54:21.728129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 91/183] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:21 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:21.733684 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-546e9a0c-1ec0-468c-aeb8-bff74ed53d78 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.221370 Jul 01 19:54:21.734314 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 93/184] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:21 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:22.744275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:22.744870 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:22.750400 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:22.750952 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:22.751089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:22.751404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:22.752157 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:22.752592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:22.758282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:22.758723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:22.759476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:22.759907 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:22.956686 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:22.961137 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:22.964553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d7a2845f-7e74-4e33-8974-cf91123af990 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.224150 Jul 01 19:54:22.965135 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 92/185] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:22 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:22.969074 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-da929c48-c788-4366-b982-98d11fe77011 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.222421 Jul 01 19:54:22.969805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 94/186] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:22 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:23.982326 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:23.982845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:23.985022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:23.985873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:23.986440 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:23.991425 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:23.991875 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:23.992635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:23.993070 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:23.993414 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:23.993889 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:23.994728 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:23.995198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:24.188731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:24.192422 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:24.196429 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d9a668c4-1056-4a39-9f3f-1bbdee5b2fbb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.218158 Jul 01 19:54:24.196996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 93/187] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:23 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:24.200111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-aaa95810-7695-4259-8d18-71e2d0b37bd1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.218293 Jul 01 19:54:24.200664 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 95/188] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:23 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:25.214486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:25.215313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:25.216464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:25.217071 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:25.219669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:25.222694 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:25.223232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:25.224274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:25.225285 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:25.225497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:25.225767 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:25.226533 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:25.226968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:25.251140 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:25.433173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:25.437125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:25.440715 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e70c4ced-8b3f-449f-a195-ab2631acb8a7 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1313 microversion: 2.1 time: 0.228104 Jul 01 19:54:25.441285 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 96/189] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:25 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:25.445349 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ae1cf72a-5ea5-49ec-911c-a11f4cc59909 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.234946 Jul 01 19:54:25.445945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 94/190] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:25 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:26.457878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:26.458481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:26.463447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:26.464050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:26.465653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:26.466115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:26.466958 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:26.467465 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:26.481675 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:26.482936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:26.483768 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:26.484206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:26.721887 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:26.726275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:26.730072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9267c1b6-3053-41e8-ba3d-02aa6db24227 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1497 microversion: 2.1 time: 0.275767 Jul 01 19:54:26.730846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 97/191] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:26 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1497 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:26.734886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1ba499f4-cd78-43cb-ab53-ae6e852a4cfd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.276540 Jul 01 19:54:26.735717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 95/192] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:26 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:27.608829 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:27.609392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:27.616599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:27.617042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:27.617828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:27.618255 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:27.646348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:54:27.745221 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-418f7add-ebd8-40da-8416-76927a36f52e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 204 len: 0 microversion: 2.1 time: 0.139850 Jul 01 19:54:27.747282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 98/193] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:54:27 2022] DELETE /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:54:27.752354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:27.752962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:27.754426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:27.755252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:27.760162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:27.760605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:27.761367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:27.761820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:27.763544 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:27.764005 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:27.764789 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:27.765552 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:27.789786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:27.998149 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:28.001052 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:28.007678 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3f334d32-9c28-44fc-ac20-6c6121543979 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.258892 Jul 01 19:54:28.008314 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 96/194] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:27 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:28.010828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b190d93b-d767-4cea-863a-5c7ebf4a5b7c tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1503 microversion: 2.1 time: 0.260511 Jul 01 19:54:28.017618 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 99/195] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:27 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1503 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:29.024597 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:29.025249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:29.031217 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:29.031833 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:29.031937 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:29.032271 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:29.033029 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:29.033462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:29.038660 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:29.039106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:29.039902 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:29.040337 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:29.174356 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:29.182209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-77d62436-ca93-44db-808d-f29370a35d57 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.162021 Jul 01 19:54:29.182938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 97/196] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:29 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:29.308150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:29.315556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-45d15ccf-a532-47bf-a500-5a51d335bda1 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1503 microversion: 2.1 time: 0.288250 Jul 01 19:54:29.316135 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 100/197] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:29 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1503 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:30.126437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:30.126922 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:30.132989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.133437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.134208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.134642 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.160344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1921bffd-1a72-49eb-86e7-f8da80838dfc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/ips" status: 200 len: 152 microversion: 2.20 time: 0.037744 Jul 01 19:54:30.160912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 98/198] 10.222.0.66 () {60 vars in 1288 bytes} [Fri Jul 1 19:54:30 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:54:30.199280 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:30.200026 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:30.206574 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.207027 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.207788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.208221 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.333724 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:30.334441 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:30.341066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.341742 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.342697 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:30.343286 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:30.347883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:30.356740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-abe3361a-003d-4c32-9a84-1acc2c55f767 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.161341 Jul 01 19:54:30.357390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 101/199] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:30 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:30.488918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:30.497805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2f514feb-0eaa-4a73-b059-37b66975da1e tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1503 microversion: 2.1 time: 0.168060 Jul 01 19:54:30.498538 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 99/200] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:30 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:31.374963 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:31.375523 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:31.383007 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:31.383479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:31.384276 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:31.384710 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:31.514267 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:31.514878 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:31.521099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:31.522157 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:31.523317 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:31.524184 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:31.527639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:31.537487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bc35a153-3240-498d-a089-99e10237d71b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.166369 Jul 01 19:54:31.538657 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 102/201] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:31 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:31.721566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:31.729670 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ef04a173-cb56-46bb-b71d-a9bba9a5449d tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1503 microversion: 2.1 time: 0.219112 Jul 01 19:54:31.730236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 100/202] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:31 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:32.342661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-1e7a46b2-74a6-4696-bd6d-f9e3a8b3ad9a req-04947b9d-32dd-4726-be22-965c1ff0ceb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5191a68-0a14-4909-bb07-841c6c8f293e", "name": "network-vif-deleted", "tag": "36d752c6-22ce-4461-9450-85e78a6e2d45"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:32.366489 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-1e7a46b2-74a6-4696-bd6d-f9e3a8b3ad9a req-04947b9d-32dd-4726-be22-965c1ff0ceb8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:32.367234 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-1e7a46b2-74a6-4696-bd6d-f9e3a8b3ad9a req-04947b9d-32dd-4726-be22-965c1ff0ceb8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.386973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-1e7a46b2-74a6-4696-bd6d-f9e3a8b3ad9a req-04947b9d-32dd-4726-be22-965c1ff0ceb8 service nova] Creating event network-vif-deleted:36d752c6-22ce-4461-9450-85e78a6e2d45 for instance e5191a68-0a14-4909-bb07-841c6c8f293e on hv-cinder-84460 Jul 01 19:54:32.394063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-1e7a46b2-74a6-4696-bd6d-f9e3a8b3ad9a req-04947b9d-32dd-4726-be22-965c1ff0ceb8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057387 Jul 01 19:54:32.395578 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 103/203] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:32.555003 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:32.556028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:32.562271 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:32.562904 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.563881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:32.564554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.698656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:32.706225 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6557d63f-8fe1-455d-beef-e7e24e4f08d3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.155528 Jul 01 19:54:32.706797 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 101/204] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:32 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:32.747397 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:32.748021 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:32.754274 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:32.754720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.756354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:32.756658 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.791088 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:32.791535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:32.791989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lazy-loading 'fault' on Instance uuid e5191a68-0a14-4909-bb07-841c6c8f293e {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:54:32.837091 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8bbb1244dca43f8947835d01b69da0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '387f55f94c784e988f8c0e240f2dc1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:32.845264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5520f77e-31dd-4955-b19c-aa18ef7a00d4 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 200 len: 1303 microversion: 2.1 time: 0.102011 Jul 01 19:54:32.845883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 104/205] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:32 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:32.912375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1398230478", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-370955949", "security_groups": [{"name": "tempest-secgroup-smoke-978391136"}], "networks": [{"uuid": "c18db701-00a1-43b8-8ecb-a7786f515087"}], "block_device_mapping_v2": [{"uuid": "745ed089-22cf-48bb-94fa-ad5add3647b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:33.027884 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] validate_networks() for [('c18db701-00a1-43b8-8ecb-a7786f515087', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:54:33.392899 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:54:33.393344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:54:33.393874 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:54:33.394281 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:54:33.394691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:54:33.404034 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.404475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.405264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.405738 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.423845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Getting quotas for project 669587fe364c4741b489449451f2294c. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:54:33.427858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Getting quotas for user c815ea64d44a48d89a2f5ff10f3f9ee8 and project 669587fe364c4741b489449451f2294c. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:54:33.485774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:54:33.487967 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='745ed089-22cf-48bb-94fa-ad5add3647b0',volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:54:33.653402 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5aa4f4f0-463f-453c-b4f4-1e0d94c7bafc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745195 Jul 01 19:54:33.654450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 102/206] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:54:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:54:33.665669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5831b0ad-9d12-4451-bb2a-d13b27f98bb6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:33.666259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5831b0ad-9d12-4451-bb2a-d13b27f98bb6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:33.724775 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:33.726216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:33.730909 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5831b0ad-9d12-4451-bb2a-d13b27f98bb6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:33.733128 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.733802 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.734762 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.735387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.739747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5831b0ad-9d12-4451-bb2a-d13b27f98bb6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1088 microversion: 2.1 time: 0.079123 Jul 01 19:54:33.744187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 105/207] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:33 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1088 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:33.751312 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:33.751847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:33.761150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.761837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.762766 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.763375 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.794173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lazy-loading 'flavor' on Instance uuid 4fe1a243-f161-4e1a-ada3-d5ef02346b96 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:54:33.897983 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:33.906310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4d025e05-5360-4062-8753-b9d2e76996ef tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.186730 Jul 01 19:54:33.906883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 103/208] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:33 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:33.914718 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:33.915486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] [instance: e5191a68-0a14-4909-bb07-841c6c8f293e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:33.922011 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.922465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.923266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:33.923701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:33.941190 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] HTTP exception thrown: Instance e5191a68-0a14-4909-bb07-841c6c8f293e could not be found. Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Request method failure captured: Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e HTTP/1.1 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1DAomrMaaPmsXybj0BCHhkUbVajpyQdIY_va_mISeEAT1cxM1zt8N1yOFxIhMZn8dbBcNJH8A05kLFLDCXv_6Oh4Z4kvbBCk7QjSW1VcAhEPnTz22dLsi7C7uYoHKVqqRlvjZXL-Hlpbbx2PNTp3oUyBA_i_9hc-Nui9J2SV3sxAU8 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 387f55f94c784e988f8c0e240f2dc1c6 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesActionsTest-1686412444 Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:54:33.943176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/387f55f94c784e988f8c0e240f2dc1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesActionsTest-1686412444 Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 387f55f94c784e988f8c0e240f2dc1c6 Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesActionsTest-1686412444 Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesActionsTest-1686412444-project Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: e8bbb1244dca43f8947835d01b69da0b Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesActionsTest-1686412444-project Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance e5191a68-0a14-4909-bb07-841c6c8f293e could not be found. Jul 01 19:54:33.944977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'e5191a68-0a14-4909-bb07-841c6c8f293e'} Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5191a68-0a14-4909-bb07-841c6c8f293e could not be found. Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:54:33.946285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5191a68-0a14-4909-bb07-841c6c8f293e could not be found. Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5191a68-0a14-4909-bb07-841c6c8f293e could not be found. Jul 01 19:54:33.947472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:33.948443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] Returning 404 to user: Instance e5191a68-0a14-4909-bb07-841c6c8f293e could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:54:33.948443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1643c9a4-3cbd-489a-b37a-7c8dbc2ecab2 tempest-VolumesActionsTest-1686412444 tempest-VolumesActionsTest-1686412444-project] 10.222.0.66 "GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e" status: 404 len: 111 microversion: 2.1 time: 0.036584 Jul 01 19:54:33.948443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 104/209] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:33 2022] GET /compute/v2.1/servers/e5191a68-0a14-4909-bb07-841c6c8f293e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:54:34.133000 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fecbe2ad-83b1-49e9-8ae7-1cbe08146460 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/action" status: 202 len: 0 microversion: 2.20 time: 0.386791 Jul 01 19:54:34.133643 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 106/210] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 1 19:54:33 2022] POST /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:54:34.142453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:34.143489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:34.152309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.152913 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.153955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.154605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.298479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:34.307457 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:34.309013 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:34.310306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5a29276b-05dd-4850-ace8-43f211364f03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.172247 Jul 01 19:54:34.310957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 105/211] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:34 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:34.762179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:34.762888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:34.769135 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.769613 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.770390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.771528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.840380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:34.850149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0acf61f4-5559-466a-b68f-ce0560de4eda tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1186 microversion: 2.1 time: 0.092919 Jul 01 19:54:34.850725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 107/212] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:34 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:34.924808 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:34.925770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:34.938187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.938755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:34.939803 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:34.940359 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.184595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:35.192097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f08c7d67-d548-497a-ae08-2b469b37e800 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.271589 Jul 01 19:54:35.193257 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 106/213] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:34 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:35.330857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:35.331384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:35.338243 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:35.338693 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.339445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:35.339879 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.471042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:35.479013 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:35.480514 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:35.481681 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ba707710-ecb8-4a91-beab-5d8211031554 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.155041 Jul 01 19:54:35.482230 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 108/214] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:35 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:35.868045 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:35.868646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:35.874619 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:35.875069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.875803 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:35.876223 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:35.937485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:35.946061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-773a059a-25ba-4e51-825c-7a259e8de7be tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1204 microversion: 2.1 time: 0.083149 Jul 01 19:54:35.946617 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 107/215] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:35 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1204 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:36.210362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:36.210980 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:36.217738 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.218185 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.218952 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.219387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.356536 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:36.365766 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4f1b8831-a487-41c3-a830-16dfacb80c5f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.159800 Jul 01 19:54:36.366403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 109/216] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:36 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:36.498807 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:36.499412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:36.506442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.506889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.507646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.508075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.638423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:36.646300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:36.647820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:36.648965 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ff3de191-a8bd-4cf2-8a18-eff1369de1fc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.153968 Jul 01 19:54:36.649516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 108/217] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:36 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:36.962825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:36.963434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:36.969549 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.970018 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:36.970773 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:36.971202 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:37.032672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:37.040110 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8b8bc561-5895-419d-8719-f7099b479d10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1204 microversion: 2.1 time: 0.081066 Jul 01 19:54:37.040673 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 110/218] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:36 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1204 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:37.382774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:37.383382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:37.389420 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:37.389893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:37.390637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:37.391068 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:37.519971 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:37.527676 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-500326ac-1d5d-4f5c-9aec-16791d66efda tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.149513 Jul 01 19:54:37.528246 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 109/219] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:37 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:37.667662 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:37.668285 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:37.674706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:37.675145 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:37.675900 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:37.676329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:37.919605 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:37.927779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:37.929409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:37.930696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b2017fe3-8866-469b-b725-ca3482af9b75 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.266895 Jul 01 19:54:37.931335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 111/220] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:37 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:38.056894 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:38.057859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:38.063800 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:38.064418 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:38.066189 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:38.066576 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:38.138447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:38.148231 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-884a720d-9ebd-4614-bc91-666d9dd2e396 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1204 microversion: 2.1 time: 0.093251 Jul 01 19:54:38.157648 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 110/221] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:38 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1204 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:38.544713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:38.545546 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:38.558666 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:38.559303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:38.560231 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:38.560817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:38.777944 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:38.785830 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e863ce45-c5af-449f-a5c2-aaadf31c1f91 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.244898 Jul 01 19:54:38.786392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 112/222] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:38 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:38.954342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:38.957667 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:38.971633 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:38.972226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:38.974671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:38.975396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.169179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:39.169836 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:39.176927 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.177781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.179231 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.180088 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.464467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:39.482931 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:39.484465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:39.485687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-05d1dc3b-56c8-4778-8f3c-44a8e1b1870b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.538199 Jul 01 19:54:39.486254 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 111/223] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:38 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:39.502423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-54862e7f-58aa-4425-afe2-7aab5742c0df req-b7135159-3839-4105-9bd7-738a4b95bd17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:39.541412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-54862e7f-58aa-4425-afe2-7aab5742c0df req-b7135159-3839-4105-9bd7-738a4b95bd17 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.542125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-54862e7f-58aa-4425-afe2-7aab5742c0df req-b7135159-3839-4105-9bd7-738a4b95bd17 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.563632 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-54862e7f-58aa-4425-afe2-7aab5742c0df req-b7135159-3839-4105-9bd7-738a4b95bd17 service nova] Creating event network-changed:1703035c-ecba-43aa-ab94-ee8dc5dedbe4 for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 on hv-cinder-84460 Jul 01 19:54:39.569226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-54862e7f-58aa-4425-afe2-7aab5742c0df req-b7135159-3839-4105-9bd7-738a4b95bd17 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081657 Jul 01 19:54:39.571139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 112/224] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:39.736006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:39.755922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7619dbfa-f18b-41a6-9e6c-83ebe8c46a64 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1271 microversion: 2.1 time: 0.593458 Jul 01 19:54:39.757329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 113/225] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:39 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1271 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:39.806893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:39.807992 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:39.819068 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.820409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.821350 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:39.822232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:39.852333 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=100 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:40.102079 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:40.111735 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-43e27e1d-c3f3-4c02-b103-3021079631e9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.311191 Jul 01 19:54:40.133409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 113/226] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:39 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:40.566116 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:40.566116 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:40.585614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:40.592431 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:40.592431 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:40.593515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:40.774430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:40.775021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:40.787844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:40.790484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:40.791574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:40.792566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:41.051925 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:41.080510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:41.080633 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:41.083854 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-beeb930f-f5ef-4c7d-a0f0-89fa483875ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.530026 Jul 01 19:54:41.085032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 114/227] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:40 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:54:41.132414 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:41.133032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:41.139729 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:41.142608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:41.144980 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:41.145535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:41.198912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:41.216206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:41.227785 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c56e2519-3d71-40bc-96b5-2949508b7dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.458627 Jul 01 19:54:41.231329 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 114/228] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:40 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:41.565460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:41.577292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e78ab1c6-e41d-4884-99f2-798d278f7274 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.449122 Jul 01 19:54:41.579386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 115/229] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:41 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:42.114884 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:42.115940 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:42.135690 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:42.136153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:42.136947 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:42.137382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:42.252787 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:42.255585 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:42.265014 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:42.265542 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:42.266584 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:42.267216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:42.428719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:42.457389 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:42.472772 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:42.476769 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cf33bb4d-7084-4f3e-bf21-5b73520df937 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.365879 Jul 01 19:54:42.493099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 115/230] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:42 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:42.596757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:42.597392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:42.605016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:42.605464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:42.612426 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:42.613130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:43.028236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:43.038221 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6b6e8586-c3b9-4715-bd2a-daf7e1547367 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.792976 Jul 01 19:54:43.048511 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 116/231] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:42 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:43.252635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:43.266160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c01dd13b-d891-4724-b3c8-cf0bf2ee76ad tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.673491 Jul 01 19:54:43.266745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 116/232] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:42 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:43.533207 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:43.535476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:43.567205 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:43.568691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:43.569882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:43.570651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:43.736132 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:43.845033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:43.857636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:43.859177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:43.860363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-64674793-b15d-4a7e-81a7-d58107df6469 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.365732 Jul 01 19:54:43.861353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 117/233] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:43 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:44.055889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:44.056905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:44.059165 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:44.059941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:44.091577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:44.092174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:44.096079 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:44.099738 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:44.286825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:44.288018 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:44.297753 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:44.301758 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:44.310399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:44.314827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b450a49f-895e-48be-87e2-0fde0e6d4873 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.263271 Jul 01 19:54:44.316429 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:44.318845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:44.322126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 117/234] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:44 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:44.645949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:44.652548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-706ef962-218b-40aa-b8d5-c6dde21ceacd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.370198 Jul 01 19:54:44.653156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 118/235] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:44 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:44.890361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:44.891241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:44.902407 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:44.903362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:44.908396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:44.909218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.159756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:45.175238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:45.180664 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:45.194790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ffd1fe25-bd34-49ac-9f16-91d18e7fa39e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.316575 Jul 01 19:54:45.195516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 118/236] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:44 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:45.340205 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:45.341411 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:45.357451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:45.358812 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.360381 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:45.361540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.567032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:45.577084 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:45.577607 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:45.580332 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c1f3d2ad-d046-416b-9e70-c4fd0ae4ba15 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.245357 Jul 01 19:54:45.581445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 119/237] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:45 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:45.588977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:45.603587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.604669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:45.605276 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.667140 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-eb152a78-0aae-4508-814f-307922b8d020 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/ips" status: 200 len: 146 microversion: 2.1 time: 0.093637 Jul 01 19:54:45.670163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:45.671580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:45.674109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 119/238] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 19:54:45 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/ips => generated 146 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:45.683917 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:45.688724 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.692184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:45.697549 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:45.957315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:45.974590 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6f106c73-b952-4283-b8b0-d30b1042de82 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1502 microversion: 2.1 time: 0.308789 Jul 01 19:54:45.975182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 120/239] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:45 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:54:45.991992 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3e8d94b-bc61-49b3-9c4e-22525170567f"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:45.993459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:46.007042 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.007753 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.009936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.013380 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.053109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] HTTP exception thrown: Cannot 'attach_volume' instance e1148781-931f-4460-a8e3-7f3654799ce7 while it is in vm_state rescued Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Request method failure captured: Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/os-volume_attachments HTTP/1.1 Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 74 Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CVZtS93PPgLkA7SnAjCSy-8tv7JQVMczG8XKUQH2Wr5Jv0Wcj7fM1JSBoBJBcnxUeEln-ujh82P1bjr4kB48_cJvgRaQ_D5wD9eHhHG8HtyxFyXD-G3eHpNaTmoPf3iicyojiK9DRAK-qkVl3Y_QZcYzIafTzQCrxNg8FnBqxaP_M Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:54:46.055242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 0267350339c44000bcc49906cfa8f0a6 Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {"volumeAttachment": {"volumeId": "d3e8d94b-bc61-49b3-9c4e-22525170567f"}} Jul 01 19:54:46.056479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Cannot 'attach_volume' instance e1148781-931f-4460-a8e3-7f3654799ce7 while it is in vm_state rescued Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'server_id': 'e1148781-931f-4460-a8e3-7f3654799ce7', 'body': {'volumeAttachment': {'volumeId': 'd3e8d94b-bc61-49b3-9c4e-22525170567f'}}} Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e1148781-931f-4460-a8e3-7f3654799ce7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:54:46.057208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e1148781-931f-4460-a8e3-7f3654799ce7 while it is in vm_state rescued Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:54:46.058364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:54:46.059390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:54:46.059390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:54:46.059390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e1148781-931f-4460-a8e3-7f3654799ce7 while it is in vm_state rescued Jul 01 19:54:46.059390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:54:46.061179 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Returning 409 to user: Cannot 'attach_volume' instance e1148781-931f-4460-a8e3-7f3654799ce7 while it is in vm_state rescued {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:54:46.062667 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-871e7187-38f2-4624-9d03-ffa09862cd6b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.075138 Jul 01 19:54:46.063775 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 120/240] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:54:45 2022] POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/os-volume_attachments => generated 152 bytes in 77 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 19:54:46.076114 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:46.076661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:46.089041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.092019 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.093296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.093798 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.214966 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:46.215716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:46.230756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.231363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.232262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.232805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.280423 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9c58bc52-a729-4f05-9eb2-08fc6763eb80 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/action" status: 202 len: 0 microversion: 2.1 time: 0.208246 Jul 01 19:54:46.288393 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 121/241] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:54:46 2022] POST /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:54:46.303600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:46.306548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:46.328106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.330325 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:46.335672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:46.336349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:47.325123 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:47.336948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b9f9cb87-e1ef-453a-a0d8-9e8e6e450ebe tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1510 microversion: 2.1 time: 1.045514 Jul 01 19:54:47.338335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 122/242] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:46 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1510 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:47.349769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:47.352119 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:47.367199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:47.379298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:47.383548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:47.387131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:47.387674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:47.398621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:47.403330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:47.425442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7bd70e96-3365-488c-bf92-ee2c1c053e10 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 1.196706 Jul 01 19:54:47.427690 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 121/243] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:46 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:47.944861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:47.972498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b0350c53-b5b6-4c2c-a709-e47f1fb9ab9e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.632731 Jul 01 19:54:47.975908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 123/244] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:47 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:48.354928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:48.355544 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:48.379430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:48.381233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:48.382235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:48.382831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:48.444858 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:48.446608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:48.466801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:48.467598 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:48.472405 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:48.473115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:48.689129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:48.701192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-fdebde0b-92f2-4812-b264-bdd49b324bf0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1510 microversion: 2.1 time: 0.349921 Jul 01 19:54:48.704444 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 122/245] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:48 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:48.725649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "852b782d-2da1-4bcc-89c1-6bb2b48ecf42"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:48.730230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:48.744396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:48.747017 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:48.748028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:48.748833 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:48.843015 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:48.852649 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:48.854157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:48.856961 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-67370d7b-2e66-49e7-9460-d6aad006da04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.416748 Jul 01 19:54:48.869346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 124/246] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:48 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:48.993295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:48.993952 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:49.007386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:49.008150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:49.010424 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:49.011113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:49.285100 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:49.322159 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7930c872-2c7a-4c01-927a-8bb0cd25ad60 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.323466 Jul 01 19:54:49.323035 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 125/247] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:48 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:49.728558 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:49.730063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:49.760174 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:49.761264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:49.762624 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:49.763546 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:50.258283 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:50.276205 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2958e1c4-9900-4e34-b9d4-69fc911b8cf3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1510 microversion: 2.1 time: 0.557521 Jul 01 19:54:50.291695 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 126/248] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:49 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1510 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:50.304446 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:50.308015 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:50.328907 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:50.334197 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:50.336941 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:50.337397 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:50.596827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:50.609099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:50.612116 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:50.614914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-603474c8-0963-422c-ae43-f66323079326 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.319816 Jul 01 19:54:50.615783 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 127/249] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:50 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:50.620639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:50.621510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:50.628450 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:50.629109 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:50.631257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:50.631846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:50.837362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:50.850262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4279527c-98f9-41c5-998e-0f046eea5bc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.233120 Jul 01 19:54:50.859933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 128/250] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:50 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:50.861955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-7d485d14-daff-4e0d-b559-a071ba11d455 req-a309d08b-f2b5-4b40-be86-8f8926a23595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "name": "network-vif-plugged", "status": "completed", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:50.877910 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-7d485d14-daff-4e0d-b559-a071ba11d455 req-a309d08b-f2b5-4b40-be86-8f8926a23595 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:50.878341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-7d485d14-daff-4e0d-b559-a071ba11d455 req-a309d08b-f2b5-4b40-be86-8f8926a23595 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:50.898220 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-7d485d14-daff-4e0d-b559-a071ba11d455 req-a309d08b-f2b5-4b40-be86-8f8926a23595 service nova] Creating event network-vif-plugged:1703035c-ecba-43aa-ab94-ee8dc5dedbe4 for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 on hv-cinder-84460 Jul 01 19:54:50.904890 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-7d485d14-daff-4e0d-b559-a071ba11d455 req-a309d08b-f2b5-4b40-be86-8f8926a23595 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049159 Jul 01 19:54:50.905999 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 129/251] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:50.974465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-249762ab-7db9-46c7-8ed2-116b323996c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.267551 Jul 01 19:54:50.976920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 123/252] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:54:48 2022] POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-volume_attachments => generated 194 bytes in 2270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:51.309328 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:51.310572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:51.332561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:51.335550 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:51.335550 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:51.335550 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:51.626591 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:51.637695 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-61f1f636-8a4b-4a2d-9111-4f83b5f1b411 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1516 microversion: 2.1 time: 0.333209 Jul 01 19:54:51.638632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 130/253] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:51 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1516 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:51.639677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:51.640447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:51.662876 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:51.663517 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:51.664490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:51.664989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:51.868640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:51.869994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:51.884587 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:51.885001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:51.885936 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:51.886451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:52.189080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:52.200410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:52.213111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:52.224773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-586e8c9d-9d4b-46dd-b250-8ee2e85ca2bc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1746 microversion: 2.20 time: 0.590708 Jul 01 19:54:52.228232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 124/254] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:51 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1746 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:52.589509 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:52.596038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:52.599263 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-49828d31-6869-4f51-9815-442600f57d5d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.734847 Jul 01 19:54:52.608129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 131/255] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:51 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:53.248762 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:53.251347 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:53.281226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:53.282082 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:53.284470 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:53.286239 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:53.508954 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0b53c1ba-66d4-4e5e-b5c3-c90fb83881b7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'create', calling method: .version_select at 0x7fa00c1a4f70>, body: {"keypair": {"name": "tempest-keypair-1041592530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMOAaZBmE4wCoQC/87QuEURcavN0tliyFSf8F6btWDYVjyE8OYX2rGzbgppHyiBJH1PFX7qqS1/5VpH8QttzTG3B0IjuIxRTQ1xLANxsbRDY2mJmmB+PWUf5l87ypBBvbg=="}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:53.580272 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-0b53c1ba-66d4-4e5e-b5c3-c90fb83881b7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:54:53.594233 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-0b53c1ba-66d4-4e5e-b5c3-c90fb83881b7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for user 0267350339c44000bcc49906cfa8f0a6 and project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:54:53.686396 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0b53c1ba-66d4-4e5e-b5c3-c90fb83881b7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183196 Jul 01 19:54:53.688761 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 132/256] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:54:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:53.698587 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:53.717040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:53.736977 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:53.737554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:53.739957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:53.754199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:54.654814 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:54.664181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ec3bd6a2-9678-4fbc-82b1-cd947c8000f9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1259 microversion: 2.1 time: 0.973839 Jul 01 19:54:54.669380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 133/257] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:53 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1259 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:54.681623 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:54.701413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:54.722846 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:54.732806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e029ba7b-56c2-4f97-9c8e-ad9976ccb1ed tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1746 microversion: 2.20 time: 1.491684 Jul 01 19:54:54.734897 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 125/258] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:53 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1746 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:54.949630 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-76828b49-e17c-451d-bf2e-80f0e5059e01 req-bc0d5c5c-c45a-4333-ba6f-6cf46cbb9757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "name": "network-vif-plugged", "status": "completed", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:54.972305 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-76828b49-e17c-451d-bf2e-80f0e5059e01 req-bc0d5c5c-c45a-4333-ba6f-6cf46cbb9757 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:54.982288 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-76828b49-e17c-451d-bf2e-80f0e5059e01 req-bc0d5c5c-c45a-4333-ba6f-6cf46cbb9757 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:55.021305 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-76828b49-e17c-451d-bf2e-80f0e5059e01 req-bc0d5c5c-c45a-4333-ba6f-6cf46cbb9757 service nova] Creating event network-vif-plugged:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:54:55.058347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-76828b49-e17c-451d-bf2e-80f0e5059e01 req-bc0d5c5c-c45a-4333-ba6f-6cf46cbb9757 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112877 Jul 01 19:54:55.061944 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 134/259] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:54:55.689230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:55.690153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:55.709312 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:55.719635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:55.728487 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:55.731504 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:55.731949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:55.758682 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:55.759777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:55.769629 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:55.812223 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:55.815030 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:55.820070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:55.820575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:56.688200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:56.697288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cda0a581-fb99-48c9-9f4e-3dc951f7232b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1444 microversion: 2.1 time: 1.015740 Jul 01 19:54:56.711724 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 126/260] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:55 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1444 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:56.719924 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:56.721027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:56.732437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:56.733986 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:56.736030 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:56.737863 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:56.755369 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:56.769631 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:56.778199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:56.783362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0b2f3235-9812-41f3-8338-c14a7bb5260e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 1.031807 Jul 01 19:54:56.786763 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 135/261] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:55 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:54:57.090200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:54:57.108070 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a974fadb-5d78-4310-af60-faace1f149c6 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1444 microversion: 2.1 time: 0.392391 Jul 01 19:54:57.109241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 127/262] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:56 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1444 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:54:57.804542 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:57.805152 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:57.817435 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:57.819184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:57.820239 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:57.823091 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:59.425440 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c59b45ca-7247-4d91-9012-a31ff87fe0fe tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:54:59.436039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c59b45ca-7247-4d91-9012-a31ff87fe0fe tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:59.436496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c59b45ca-7247-4d91-9012-a31ff87fe0fe tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:59.687985 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c59b45ca-7247-4d91-9012-a31ff87fe0fe tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Going to try to stop instance {{(pid=124287) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 19:54:59.768375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:54:59.813233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c59b45ca-7247-4d91-9012-a31ff87fe0fe tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action" status: 202 len: 0 microversion: 2.1 time: 0.393255 Jul 01 19:54:59.819746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 128/263] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:54:59 2022] POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:54:59.845034 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:54:59.846850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:54:59.868053 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:59.871068 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:54:59.874080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:54:59.874755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:00.352787 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:00.372191 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:00.373951 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:00.376960 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-43d84129-d1ca-46ca-800b-24de09232208 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 2.577998 Jul 01 19:55:00.385768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 136/264] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:54:57 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 2586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:00.595951 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:00.620608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-07f74a09-8163-4339-867e-321a7d2133c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.786584 Jul 01 19:55:00.622203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 129/265] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:54:59 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:01.222739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-960667444", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "13dd580c-809a-4f73-9432-a6d0838269e1"}], "security_groups": [{"name": "tempest-securitygroup--366205461"}], "key_name": "tempest-keypair-1041592530", "user_data": "}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:01.412592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:01.413531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:01.436178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:01.436908 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:01.440297 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:01.440966 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:02.462140 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:02.479077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:02.481005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:02.482566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f8439a91-130a-49d1-beaf-7af279b04950 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 1.079616 Jul 01 19:55:02.483693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 130/266] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:01 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:02.494306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:02.495265 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:02.505648 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:02.509565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:02.510771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:02.511535 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:02.775334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:02.784433 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7ead03dd-9783-421b-a633-fdd15fc4c7e1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.299447 Jul 01 19:55:02.795537 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 131/267] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:02 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:03.405976 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7091cdf7-a33c-436d-81c9-c882ec175ffe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Action: 'create', calling method: .version_select at 0x7fa00c109d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1633635879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMbI5ZYwf9hZwit2dp+qSdK9+p/t1Y8MtL7XtIWHNU31anXlNTsSMB/811Q9HhJatcefIGDC7DHu7ki/ndbjNMuFhQcPZLbnyjyWTcI+nsxeT5PxgdaWul2hY+A+2RE7g=="}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:03.440826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-7091cdf7-a33c-436d-81c9-c882ec175ffe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for project 262e5b1a6f6248cca455437d23b8d441. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:55:03.447202 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-7091cdf7-a33c-436d-81c9-c882ec175ffe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for user 80267c31f3fc4b3fbc8dc7ed03326eeb and project 262e5b1a6f6248cca455437d23b8d441. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:55:03.486353 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7091cdf7-a33c-436d-81c9-c882ec175ffe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.689214 Jul 01 19:55:03.487632 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 132/268] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:55:02 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:03.503627 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:03.507966 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:03.521009 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:03.525193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:03.532630 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:03.536437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:03.637044 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=4 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:04.922512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:04.932265 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:04.944238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:04.947551 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-92ae3539-9e49-48d5-a7d8-1a88ba3f23de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 1.447740 Jul 01 19:55:04.966170 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 133/269] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:03 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:04.979778 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:04.982592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:04.996102 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:05.003646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:05.006999 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:05.008344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:05.741006 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:05.756695 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-28dd62e7-a4f1-4e71-a5c2-b111500aa73f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.789090 Jul 01 19:55:05.760387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 134/270] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:04 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:05.959488 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-ce5d9d9e-2a0e-4f76-bab0-07b0ef0240be req-a0c2e7db-31f6-4004-9a45-adae35ff63bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:05.985901 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-ce5d9d9e-2a0e-4f76-bab0-07b0ef0240be req-a0c2e7db-31f6-4004-9a45-adae35ff63bc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:05.990965 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-ce5d9d9e-2a0e-4f76-bab0-07b0ef0240be req-a0c2e7db-31f6-4004-9a45-adae35ff63bc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:06.036138 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-ce5d9d9e-2a0e-4f76-bab0-07b0ef0240be req-a0c2e7db-31f6-4004-9a45-adae35ff63bc service nova] Creating event network-changed:1703035c-ecba-43aa-ab94-ee8dc5dedbe4 for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 on hv-cinder-84460 Jul 01 19:55:06.065295 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-ce5d9d9e-2a0e-4f76-bab0-07b0ef0240be req-a0c2e7db-31f6-4004-9a45-adae35ff63bc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110662 Jul 01 19:55:06.090578 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 135/271] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:06.107014 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:06.121953 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:06.148945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:06.149989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:06.152122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:06.153553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:06.658264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:06.672801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:06.675500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:06.679606 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-fa33fb56-c88a-49fc-99ff-e961ad8b5e22 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.584361 Jul 01 19:55:06.680635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 136/272] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:06 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:06.779430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:06.780129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:06.793172 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:06.793676 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:06.795459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:06.796147 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:07.102504 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:07.112227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b649a38a-9c5d-4994-a58a-05b1cfe6a6a1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.338271 Jul 01 19:55:07.116586 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 137/273] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:06 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:07.701203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:07.702285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:07.720514 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:07.723924 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:07.725050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:07.730813 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:08.128325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:08.138588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:08.140080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:08.141266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-73ea3fc0-218a-41db-b75d-442a7a5af12e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.446474 Jul 01 19:55:08.141865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 138/274] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:07 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:08.177249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:08.181525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:08.214236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:08.218019 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:08.218854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:08.219298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:08.786873 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:08.799392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a903baae-0b06-4fcc-80cd-416685ebaf40 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.649178 Jul 01 19:55:08.811978 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 139/275] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:08 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:09.164012 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:09.166483 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:09.200468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:09.202642 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:09.206831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:09.215109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:09.501133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:09.511716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:09.513938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:09.515471 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-526f1329-7811-4184-9575-a09e42fb3acb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.358607 Jul 01 19:55:09.516560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 140/276] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:09 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:09.818330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:09.820149 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:09.846911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:09.849945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:09.854601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:09.855190 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:10.312496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:10.352431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-95fe08ca-5460-4a68-87f0-24cee34c692e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.539664 Jul 01 19:55:10.353233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 141/277] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:09 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:10.357020 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=20 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:10.536378 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:10.536984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:10.558380 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:10.559126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:10.560081 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:10.561309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:10.909227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:10.923090 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:10.933338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:10.935452 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-49388047-2cf2-4118-8a8a-0d01fb3c7ccf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.404365 Jul 01 19:55:10.940387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 142/278] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:10 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:11.248522 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=5 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:11.377129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:11.377824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:11.388613 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:11.389077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:11.397949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:11.398763 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:11.851634 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:11.878673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c7c65a73-2bba-4a75-8270-da247b692a1f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.510365 Jul 01 19:55:11.882234 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 143/279] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:11 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:11.958695 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:11.959493 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:11.972215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:11.973319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:11.974303 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:11.976143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:12.267985 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:12.280218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:12.285620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:12.285620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f849f2a3-272a-4363-acae-15a2e92fd5f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.332061 Jul 01 19:55:12.313903 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 144/280] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:11 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:12.901463 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:12.903014 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:12.920352 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:12.921212 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:12.924470 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:12.925293 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:13.213086 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:13.223275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-61680ae1-b234-495d-b549-11c85aa69b98 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.327507 Jul 01 19:55:13.224523 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 145/281] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:12 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:13.312492 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:13.313450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:13.324460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:13.325234 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:13.326053 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:13.326582 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:13.460276 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=4 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:13.535976 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:13.541068 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:13.565402 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:13.567510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:13.568706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-519e650c-be50-4e23-be1b-32e3f114bc8f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.260332 Jul 01 19:55:13.569252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 146/282] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:13 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:13.684163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] validate_networks() for [('13dd580c-809a-4f73-9432-a6d0838269e1', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:55:14.245069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:14.251773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:14.281025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:14.281771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:14.282611 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:14.283051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:14.526925 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:55:14.528057 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:55:14.528537 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:55:14.529003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:55:14.529966 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:55:14.544472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:14.544924 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:14.545998 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:14.546609 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:14.572187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:55:14.577286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Getting quotas for user 0267350339c44000bcc49906cfa8f0a6 and project 0ba0ddfd3efd41ee9687efe014c40bf0. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:55:14.590458 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:55:14.593218 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:55:14.609781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:14.625430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c310029f-cbe8-4d6e-821a-cff4d1bba9ea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1724 microversion: 2.1 time: 0.388034 Jul 01 19:55:14.628920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 147/283] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:14 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:14.643001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:14.643939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:14.657750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:14.662767 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:14.664150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:14.664600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:14.701953 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a37a2bd1-63e5-4b3b-bf83-dbe793655f5a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 13.485652 Jul 01 19:55:14.703198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 137/284] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:55:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 13487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:55:14.714816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-90da09e0-116e-4e21-be6a-303d4c5eddee tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:14.715663 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-90da09e0-116e-4e21-be6a-303d4c5eddee tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:14.824796 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-90da09e0-116e-4e21-be6a-303d4c5eddee tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:14.835837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-90da09e0-116e-4e21-be6a-303d4c5eddee tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1245 microversion: 2.1 time: 0.126118 Jul 01 19:55:14.836823 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 138/285] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:14 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1245 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:14.944628 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:14.955841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:14.957952 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:14.959120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-727e35ae-9e65-47cf-a910-e10f73972f98 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.328649 Jul 01 19:55:14.959964 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 148/286] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:14 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:15.645656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:15.646355 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:15.653225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.653697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.654488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.654923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.791151 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:15.799237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-55077b6c-44f9-4f56-b810-98c456a3453a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1701 microversion: 2.1 time: 0.157995 Jul 01 19:55:15.799800 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 139/287] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:15 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1701 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:15.817267 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-88a2a16b-fc48-4b0e-96c2-c91c2951e5e4 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:15.825427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-88a2a16b-fc48-4b0e-96c2-c91c2951e5e4 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.825931 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-88a2a16b-fc48-4b0e-96c2-c91c2951e5e4 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.849733 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-88a2a16b-fc48-4b0e-96c2-c91c2951e5e4 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Going to try to start instance {{(pid=124287) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 19:55:15.856005 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:15.857192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:15.866943 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.867633 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.868976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.869676 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.898437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-88a2a16b-fc48-4b0e-96c2-c91c2951e5e4 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action" status: 202 len: 0 microversion: 2.1 time: 0.085207 Jul 01 19:55:15.899296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 149/288] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:55:15 2022] POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:55:15.908565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:15.909500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:15.916498 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.916950 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.917753 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.918194 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.951913 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:15.960124 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-272ca2ec-2c63-4bd3-b288-bedf3ab68be5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1297 microversion: 2.1 time: 0.110218 Jul 01 19:55:15.960915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 140/289] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:15 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:15.979057 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:15.979797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:15.985936 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.986454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:15.987287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:15.988487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:16.095856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:16.104683 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7c8fd8fc-8743-407a-b292-5a66fd8d814c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1710 microversion: 2.1 time: 0.200733 Jul 01 19:55:16.105248 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 150/290] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:15 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1710 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:16.142622 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:16.151094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:16.152610 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:16.153806 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-562fdcbf-865c-47d0-8c7f-1b65f82c4459 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1741 microversion: 2.20 time: 0.178662 Jul 01 19:55:16.154375 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 141/291] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:15 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1741 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:16.983414 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:16.985215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:16.999887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:17.000873 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:17.004573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:17.011951 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:17.122677 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:17.123286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:17.131176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:17.131917 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:17.132928 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:17.133499 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:17.569770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:17.583770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-54ccaa28-eb4c-48ff-b870-8dff5de4c599 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1303 microversion: 2.1 time: 0.607193 Jul 01 19:55:17.584783 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 151/292] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:16 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1303 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:17.590175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:17.590984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:17.608507 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:17.609363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:17.610774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:17.611600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:17.980103 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:18.010725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-401cd83c-addf-41ae-8015-7563a3b8f765 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1710 microversion: 2.1 time: 0.881799 Jul 01 19:55:18.014073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 142/293] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:17 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1710 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:18.086704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:18.096188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:18.099773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:18.100962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-54bf7460-5c8d-48b6-a34a-0fa4d997627b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1723 microversion: 2.20 time: 0.514874 Jul 01 19:55:18.101517 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 152/294] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:17 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:18.492912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-83eae332-b000-4d39-b1ae-d901c15ef8f2 req-9eb4f29d-fbe0-4a18-8765-0129fa56f4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d64b8-42ce-4ab0-9256-f6dae97073d7", "tag": "f3f91ef6-766f-417a-aa5e-c828666be6fa"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:18.510258 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-83eae332-b000-4d39-b1ae-d901c15ef8f2 req-9eb4f29d-fbe0-4a18-8765-0129fa56f4b8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:18.510716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-83eae332-b000-4d39-b1ae-d901c15ef8f2 req-9eb4f29d-fbe0-4a18-8765-0129fa56f4b8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:18.549353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-83eae332-b000-4d39-b1ae-d901c15ef8f2 req-9eb4f29d-fbe0-4a18-8765-0129fa56f4b8 service nova] Creating event network-changed:f3f91ef6-766f-417a-aa5e-c828666be6fa for instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 on hv-cinder-84460 Jul 01 19:55:18.570731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-83eae332-b000-4d39-b1ae-d901c15ef8f2 req-9eb4f29d-fbe0-4a18-8765-0129fa56f4b8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083593 Jul 01 19:55:18.571623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 143/295] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:18.601461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:18.602144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:18.609354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:18.609886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:18.610693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:18.611395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:18.791516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:18.799485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0b3668e4-7758-424f-92b9-26af419e9fd2 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.202413 Jul 01 19:55:18.800120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 153/296] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:18 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:19.034067 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:19.035222 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:19.043880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:19.044899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:19.046567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:19.047209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:19.120935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:19.122522 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:19.130866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:19.131313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:19.132104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:19.132536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:19.251067 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:19.261979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-abffb52b-1f80-4400-8c3a-84e7399a42c5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1710 microversion: 2.1 time: 0.231809 Jul 01 19:55:19.262813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 144/297] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:19 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1710 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:19.299820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:19.309327 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:19.310903 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:19.312071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-dd1e4e76-2ad0-4997-ae8e-caf3c10a591f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1723 microversion: 2.20 time: 0.195260 Jul 01 19:55:19.312637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 154/298] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:19 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:19.817758 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:19.819286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:19.835859 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:19.836668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:19.837659 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:19.838892 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.002847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:20.012071 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2b33555c-bd0d-4b9c-b2ad-5e8cd6271b2f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.199354 Jul 01 19:55:20.013367 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 145/299] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:19 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:20.255387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-d224806a-1fb5-40aa-bd12-a2d3adac9220 req-379b507a-3472-48ae-8707-aac4c92be7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "name": "network-vif-unplugged", "status": "completed", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:20.270215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-d224806a-1fb5-40aa-bd12-a2d3adac9220 req-379b507a-3472-48ae-8707-aac4c92be7c6 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.271837 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-d224806a-1fb5-40aa-bd12-a2d3adac9220 req-379b507a-3472-48ae-8707-aac4c92be7c6 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.284080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:20.284884 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:20.288769 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-d224806a-1fb5-40aa-bd12-a2d3adac9220 req-379b507a-3472-48ae-8707-aac4c92be7c6 service nova] Creating event network-vif-unplugged:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:55:20.295560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-d224806a-1fb5-40aa-bd12-a2d3adac9220 req-379b507a-3472-48ae-8707-aac4c92be7c6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044794 Jul 01 19:55:20.296410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 155/300] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:20.303926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.304378 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.305153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.305606 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.332440 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:20.333278 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:20.345641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.346279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.350771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.351331 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.505129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:20.515348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f62a7f23-46d0-40cd-94af-12bf78545406 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1710 microversion: 2.1 time: 0.238431 Jul 01 19:55:20.515949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 146/301] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:20 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1710 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:20.614025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:20.621844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:20.623356 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:20.624546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-af9d8290-a18a-4403-9642-35731abd6137 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1726 microversion: 2.20 time: 0.297181 Jul 01 19:55:20.625599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 156/302] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:20 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1726 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:20.648112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94383c7c-73ef-4696-aa4c-442eeea784ae"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:20.649256 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:20.657696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.658254 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.659216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:20.669351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:20.974770 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e9303ab6-da12-4f22-a5fe-895c12c5d898 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.331226 Jul 01 19:55:20.975674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 147/303] 10.222.0.66 () {62 vars in 1363 bytes} [Fri Jul 1 19:55:20 2022] POST /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments => generated 188 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:55:21.030812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:21.031565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:21.038379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.038830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.041566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.042060 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.098467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:21.099264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:21.106493 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.107268 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.108159 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.108556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.226825 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:21.235378 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3463d473-9114-493f-bda4-6bc732c87fa4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/action" status: 202 len: 0 microversion: 2.20 time: 0.141326 Jul 01 19:55:21.236228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-dfb1d10e-9586-4ec6-a568-dc42a1b591cd tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.209530 Jul 01 19:55:21.236497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 148/304] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 1 19:55:21 2022] POST /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:55:21.237187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 157/305] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:21 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:21.247727 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:21.248748 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:21.256599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.257337 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.258873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.258958 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.411540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:21.424390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:21.426560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:21.427743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e43fdc99-26e2-4df3-8e6b-0484430eb3d8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.184111 Jul 01 19:55:21.428444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 149/306] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:21 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:21.534560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:21.535176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:21.541324 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.541813 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.542593 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:21.543029 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:21.694150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:21.703076 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5313e3dd-bf3d-4b49-819d-af89a1d46bc3 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1714 microversion: 2.1 time: 0.172627 Jul 01 19:55:21.714558 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 158/307] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:21 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1714 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:22.258813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:22.258813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:22.265948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:22.266498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:22.267595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:22.268443 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:22.446380 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:22.447049 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:22.450791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:22.459031 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:22.459492 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:22.460315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-18c4819b-feef-4082-ae7c-7d4349f83eb8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.208797 Jul 01 19:55:22.461062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:22.461202 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 150/308] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:22 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:22.461519 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:22.610656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:22.619738 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:22.621230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:22.622437 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-70516748-9eda-4b03-a6e8-0e1725bf89e4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.179996 Jul 01 19:55:22.623023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 159/309] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:22 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:23.478635 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:23.479349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:23.486696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:23.487076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:23.489026 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:23.489525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:23.644525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:23.645218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:23.652633 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:23.653215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:23.654028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:23.654636 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:23.734304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:23.742264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c413cb7e-4315-48f0-8b04-1ea88794376b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.267723 Jul 01 19:55:23.742770 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 151/310] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:23 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:23.849906 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:23.858939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:23.860545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:23.861657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b228d459-be50-4161-b90c-95abb5bc1b40 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.224073 Jul 01 19:55:23.862225 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 160/311] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:23 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:24.757791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:24.764920 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:24.766449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:24.785486 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:24.787350 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:24.788906 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:24.789758 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:24.827548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:24.835345 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=8 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:24.881883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:24.883234 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:24.900856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:24.901382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:24.902304 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:24.902735 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:25.042792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:25.055331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f3413201-01a6-4293-b3b9-28ffa1262a9f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.296863 Jul 01 19:55:25.063679 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 152/312] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:24 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:25.111783 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:25.121619 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:25.123420 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:25.124588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8cd7c081-41d6-4bba-8fe1-033342b921e5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.248022 Jul 01 19:55:25.125134 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 161/313] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:24 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:26.071682 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:26.072314 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:26.079164 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:26.079616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:26.080391 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:26.080829 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:26.144201 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:26.145096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:26.152581 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:26.154208 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:26.154904 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:26.155907 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:26.156744 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:26.264407 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:26.274172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-18ae429f-379e-4850-b7c6-b46104b416f6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.206881 Jul 01 19:55:26.275462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 153/314] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:26 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:26.345296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-bc95088b-0105-4ca1-81b7-8862bb167130 req-33ecf528-840d-4b6e-8e8b-1e57780446fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d64b8-42ce-4ab0-9256-f6dae97073d7", "name": "network-vif-plugged", "status": "completed", "tag": "f3f91ef6-766f-417a-aa5e-c828666be6fa"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:26.356627 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-bc95088b-0105-4ca1-81b7-8862bb167130 req-33ecf528-840d-4b6e-8e8b-1e57780446fb service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:26.357259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-bc95088b-0105-4ca1-81b7-8862bb167130 req-33ecf528-840d-4b6e-8e8b-1e57780446fb service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:26.365482 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:26.375036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:26.377416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:26.380053 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7be95e3d-fa50-495f-a0a6-a4e91a0af2f7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.240216 Jul 01 19:55:26.380957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 162/315] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:26 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:26.381976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-bc95088b-0105-4ca1-81b7-8862bb167130 req-33ecf528-840d-4b6e-8e8b-1e57780446fb service nova] Creating event network-vif-plugged:f3f91ef6-766f-417a-aa5e-c828666be6fa for instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 on hv-cinder-84460 Jul 01 19:55:26.389139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-bc95088b-0105-4ca1-81b7-8862bb167130 req-33ecf528-840d-4b6e-8e8b-1e57780446fb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053391 Jul 01 19:55:26.390989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 154/316] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:55:27.292179 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:27.292701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:27.299279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:27.299722 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:27.300492 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:27.302301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:27.306671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:27.400880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:27.401599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:27.407977 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:27.408478 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:27.409203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:27.409914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:27.466695 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:27.474740 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-464311e8-1bcb-4555-a306-9ea1d72ee403 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.186470 Jul 01 19:55:27.475328 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 163/317] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:27 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:27.559173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:27.568750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:27.571583 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:27.572777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3060a402-e57b-4bbb-b32c-2be4300611c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.177677 Jul 01 19:55:27.573366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 155/318] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:27 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:28.492598 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:28.493898 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:28.500601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:28.501229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:28.502062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:28.502443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:28.590724 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:28.591336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:28.599754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:28.600482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:28.601428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:28.601894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:28.659665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:28.668120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3b46d263-aa71-4081-a8cd-f8df6ed5607d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1370 microversion: 2.1 time: 0.179724 Jul 01 19:55:28.668684 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 164/319] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:28 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:28.748843 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:28.758846 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:28.760555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:28.761780 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-03bb343c-003d-4991-a733-70cc211a2a70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.174843 Jul 01 19:55:28.762332 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 156/320] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:28 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:29.684403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:29.685012 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:29.691652 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:29.692095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:29.692850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:29.693283 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:29.786525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:29.787069 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:29.794475 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:29.794926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:29.795784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:29.796421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:29.848669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:29.856408 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0abb90ce-e03b-4cf7-9587-d427ae96a63c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1564 microversion: 2.1 time: 0.175882 Jul 01 19:55:29.856979 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 165/321] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:29 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:29.872760 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:29.873520 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:29.882191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:29.882841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:29.883608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:29.884261 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:29.944863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:29.958598 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:29.960349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:29.961718 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fbb95f0d-e04a-4412-84b4-dadf9dcc6862 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1752 microversion: 2.20 time: 0.180075 Jul 01 19:55:29.962436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 157/322] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:29 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1752 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:29.984137 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e1bb28b2-ee29-4eec-8fad-506fe15e9b94 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115012 Jul 01 19:55:29.984793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 166/323] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 19:55:29 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:30.983902 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:30.984661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:30.991805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:30.992276 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:30.993031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:30.993509 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:31.174939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:31.178678 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:31.179346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:31.180701 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-223094f7-c4dd-4617-a67a-f874d936609a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1754 microversion: 2.20 time: 0.200900 Jul 01 19:55:31.181441 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 158/324] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:30 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1754 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:31.210808 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-3346d442-995d-4808-86cc-d3a8de22f2db req-01cd89b5-2d62-437b-a323-696bffcd98f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d64b8-42ce-4ab0-9256-f6dae97073d7", "tag": "f3f91ef6-766f-417a-aa5e-c828666be6fa"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:31.229357 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-3346d442-995d-4808-86cc-d3a8de22f2db req-01cd89b5-2d62-437b-a323-696bffcd98f9 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:31.229851 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-3346d442-995d-4808-86cc-d3a8de22f2db req-01cd89b5-2d62-437b-a323-696bffcd98f9 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:31.242657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-3346d442-995d-4808-86cc-d3a8de22f2db req-01cd89b5-2d62-437b-a323-696bffcd98f9 service nova] Creating event network-changed:f3f91ef6-766f-417a-aa5e-c828666be6fa for instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 on hv-cinder-84460 Jul 01 19:55:31.247746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-3346d442-995d-4808-86cc-d3a8de22f2db req-01cd89b5-2d62-437b-a323-696bffcd98f9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042778 Jul 01 19:55:31.248349 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 167/325] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:32.201468 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:32.202262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:32.209684 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:32.210274 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:32.211394 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:32.212003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:32.453873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:32.462756 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:32.465305 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:32.466518 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5305c20e-d614-4c04-a17f-670d3a9dfec4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.270500 Jul 01 19:55:32.467081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 159/326] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:32 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:33.489616 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:33.490342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:33.497789 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:33.498237 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:33.499069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:33.499683 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:33.638907 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:33.648228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:33.649727 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:33.651152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3a7b3658-4310-427c-a855-953ce6fca9c7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.166650 Jul 01 19:55:33.651707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 168/327] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:33 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:34.669659 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:34.670265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:34.677949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:34.678419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:34.679511 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:34.679957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:35.038827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:35.047720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:35.049207 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:35.050380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-75f2d976-8f80-4cf4-bfdd-9ca18db8a36f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.384622 Jul 01 19:55:35.050918 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 160/328] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:34 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:36.068633 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:36.070105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:36.076742 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:36.077175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:36.077961 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:36.078387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:36.252017 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:36.269659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:36.274555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:36.279115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3edefe52-193a-4956-83ce-737be0e6106b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.214670 Jul 01 19:55:36.291643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 169/329] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:36 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:37.308039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:37.308039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:37.308701 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:37.309407 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:37.311748 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:37.312381 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:37.492267 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:37.510162 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:37.511828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:37.513403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b66a9474-d57f-4f83-935a-30422d91d696 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.217181 Jul 01 19:55:37.514044 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 161/330] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:37 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:37.970524 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1876513137", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1633635879", "security_groups": [{"name": "tempest-secgroup-smoke-1127916334"}], "block_device_mapping_v2": [{"uuid": "bb8ed8a3-df8a-4b9d-8aa0-ff210ced532e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8fd60a7-929d-43ab-ae8d-d1c7691811e9"}]}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:38.092173 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] validate_networks() for [('e8fd60a7-929d-43ab-ae8d-d1c7691811e9', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:55:38.499850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:55:38.503685 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:55:38.506039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:55:38.506759 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:55:38.507447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:55:38.522110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:38.522882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:38.523654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:38.524090 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:38.532255 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:38.532862 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:38.543331 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for project 262e5b1a6f6248cca455437d23b8d441. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:55:38.545777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:38.546629 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:38.547767 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:38.548559 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:38.550192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for user 80267c31f3fc4b3fbc8dc7ed03326eeb and project 262e5b1a6f6248cca455437d23b8d441. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:55:38.662346 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:55:38.664841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb8ed8a3-df8a-4b9d-8aa0-ff210ced532e',volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:55:38.742372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:38.753739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:38.757777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:38.759552 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-02348f04-f825-497e-8fb3-ad40589d436e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.230956 Jul 01 19:55:38.770053 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 162/331] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:38 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:55:38.845665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f0df406a-f908-4f20-a11b-d715b0b56878 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.879077 Jul 01 19:55:38.846378 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 170/332] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:55:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:55:38.857366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-80f2ccbb-9ade-4a9d-a1d0-12a24ac6ffe8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:38.858315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-80f2ccbb-9ade-4a9d-a1d0-12a24ac6ffe8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:38.953679 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-80f2ccbb-9ade-4a9d-a1d0-12a24ac6ffe8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:38.962429 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-80f2ccbb-9ade-4a9d-a1d0-12a24ac6ffe8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1095 microversion: 2.1 time: 0.109105 Jul 01 19:55:38.963712 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 163/333] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:38 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1095 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:39.777641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:39.778427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:39.785192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:39.786022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:39.787174 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:39.787831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:39.925632 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:39.934784 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:39.936651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:39.938138 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1f6c4027-bb2f-42bf-a0a0-b44615205dac tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.164764 Jul 01 19:55:39.946163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 171/334] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:39 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:39.979633 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:39.980238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:39.989310 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:39.989310 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:39.989310 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:39.989733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:40.053194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:40.061098 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dbdaa13a-1a60-416e-83da-5485b82bbb1d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.085275 Jul 01 19:55:40.061680 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 164/335] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:39 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:40.956322 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:40.957103 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:40.965315 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:40.966204 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:40.967202 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:40.967739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:41.078523 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:41.079125 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:41.087809 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:41.088360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:41.089182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:41.089727 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:41.110315 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:41.120030 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:41.121527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:41.122882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0d78e6a9-2b78-437e-a6ce-222a73a948c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.170514 Jul 01 19:55:41.123456 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 172/336] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:40 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:41.159923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:41.168712 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-43b1050e-87fa-4dd0-98d0-c4a92bb26c13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.094099 Jul 01 19:55:41.169274 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 165/337] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:41 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:42.141647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:42.143003 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:42.152337 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:42.152898 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:42.153787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:42.154288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:42.186778 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:42.187252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:42.196774 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:42.198486 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:42.198935 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:42.199702 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:42.200135 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:42.281296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:42.290551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5e84fcfc-4af3-4c2d-b3c9-7db01f0dae4c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.108420 Jul 01 19:55:42.291129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 166/338] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:42 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:42.346018 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:42.355906 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:42.357872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:42.359456 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-58433e85-00c3-4ad8-8302-bc35f84023ef tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.221554 Jul 01 19:55:42.360032 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 173/339] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:42 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:43.307426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:43.308094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:43.315923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:43.316363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:43.317781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:43.318209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:43.378431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:43.380776 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:43.387101 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:43.388066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:43.388517 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:43.389936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:43.390573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:43.397673 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-42327991-84fa-43de-b6cd-4ca3f4385b72 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.094026 Jul 01 19:55:43.402520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 167/340] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:43 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:43.572200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:43.582039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:43.583530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:43.584680 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-394e736b-0256-4c36-b6bb-9caf5d997c33 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.210222 Jul 01 19:55:43.585240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 174/341] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:43 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:44.419220 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:44.419797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:44.426949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.427707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.428774 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.429467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.510765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:44.518301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a178d363-31d9-4a7a-a633-1b604de83663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.103034 Jul 01 19:55:44.518857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 168/342] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:44 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:44.603090 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:44.603764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:44.610431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.610887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.611698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:44.612349 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:44.768349 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:44.778155 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:44.779900 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:44.781383 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1c2451ac-5c14-4632-b03d-616dc479ca25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.182364 Jul 01 19:55:44.782081 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 175/343] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:44 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:45.537305 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:45.538078 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:45.544739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.545425 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.546838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.547436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.613979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:45.621883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b98d8922-4ac5-4fb8-ad5f-3036c24963e3 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.089214 Jul 01 19:55:45.622457 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 169/344] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:45 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:45.800484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:45.801471 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:45.808002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.808379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.809123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:45.809550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:45.947791 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:45.958587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:45.960537 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:45.962173 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c9269a2f-84d1-471c-a0b9-aca6644357b9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.165210 Jul 01 19:55:45.968501 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 176/345] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:45 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:46.638965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:46.639564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:46.647250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.647691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:46.648458 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.649071 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:46.670593 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:46.716291 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:46.724638 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1b4e2fee-4f95-4b58-9ed3-c4b6f7e9e0a4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.089511 Jul 01 19:55:46.725982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 170/346] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:46 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:46.985733 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:46.986341 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:46.993975 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.994451 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:46.995214 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:46.995740 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:47.133805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:47.142386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:47.143888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:47.145092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7c6be8c6-b1bd-4b48-821a-79179db2b61d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.163190 Jul 01 19:55:47.145673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 177/347] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:46 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:47.742514 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:47.743062 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:47.749868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:47.750308 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:47.751080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:47.751505 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:47.815418 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:47.824615 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4a3383fe-cd78-4ff3-a280-e9e48e2a87b2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.086581 Jul 01 19:55:47.826224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 171/348] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:47 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:48.163382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:48.164008 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:48.170511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.170949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.171713 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.172124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.314895 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:48.323833 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:48.325311 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:48.326475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b59b34ee-3bf3-4485-839a-1a3ded91994e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.166993 Jul 01 19:55:48.327030 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 178/349] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:48 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:48.843186 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:48.843792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:48.850829 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.851276 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.852089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:48.852466 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:48.913768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:48.921252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d29574b7-f0c8-414f-bee8-9cb417bb3819 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1145 microversion: 2.1 time: 0.081944 Jul 01 19:55:48.922173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 172/350] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:48 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:49.345780 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:49.346515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:49.350796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:49.352016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:49.357192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:49.357646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:49.358422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:49.358862 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:49.569762 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:49.578207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:49.579750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:49.580918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5fe706e3-9348-4b2a-8c30-416668501836 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.239255 Jul 01 19:55:49.581470 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 179/351] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:49 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:49.939570 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:49.940358 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:49.942968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:49.948996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:49.949792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:49.950578 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:49.951192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:50.020321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:50.028129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7560e70d-d071-4190-a452-7f88eb7a9617 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1201 microversion: 2.1 time: 0.092840 Jul 01 19:55:50.028693 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 173/352] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:49 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1201 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:50.600713 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:50.601241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:50.610307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:50.610307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:50.610307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:50.610307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:50.814505 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:50.825416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:50.827794 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:50.830255 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c207f88d-a179-4d27-9d12-57afe97f6617 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.234076 Jul 01 19:55:50.831040 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 180/353] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:50 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:51.045554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:51.046207 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:51.054401 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.055090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:51.056041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.056817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:51.342719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:51.351032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b1273b7c-9e98-4947-ad45-ff9b6920a606 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1279 microversion: 2.1 time: 0.309299 Jul 01 19:55:51.351570 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 174/354] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:51 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1279 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:51.736418 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-3606c1eb-9070-41e5-a637-a299a42d1878 req-7917e46b-ac73-4df0-890e-c4736bfc06d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abdbc8c7-9db6-4914-8ad4-b55ee6460761", "tag": "f9cbac97-cb1e-4639-8812-c364aa6fa31d"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:55:51.756615 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-3606c1eb-9070-41e5-a637-a299a42d1878 req-7917e46b-ac73-4df0-890e-c4736bfc06d1 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.757059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-3606c1eb-9070-41e5-a637-a299a42d1878 req-7917e46b-ac73-4df0-890e-c4736bfc06d1 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:51.769813 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-3606c1eb-9070-41e5-a637-a299a42d1878 req-7917e46b-ac73-4df0-890e-c4736bfc06d1 service nova] Creating event network-changed:f9cbac97-cb1e-4639-8812-c364aa6fa31d for instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 on hv-cinder-84460 Jul 01 19:55:51.778153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-3606c1eb-9070-41e5-a637-a299a42d1878 req-7917e46b-ac73-4df0-890e-c4736bfc06d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051036 Jul 01 19:55:51.778781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 181/355] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:55:51.850708 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:51.851372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:51.857959 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.858988 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:51.859987 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:51.860656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:52.076950 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:52.086314 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:52.087806 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:52.089165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d11a255d-f943-4610-b5a8-6e2bef64459d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.243014 Jul 01 19:55:52.089917 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 175/356] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:51 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:52.370429 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:52.371306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:52.377830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:52.378386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:52.379455 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:52.379944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:52.384527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=100 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:52.519044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:52.527978 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-fee160f6-a15b-4f92-ba0a-4b2a38b96ac7 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.162458 Jul 01 19:55:52.528790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 182/357] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:52 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:53.108071 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:53.108680 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:53.116334 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:53.116711 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:53.117933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:53.118357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:53.260169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:53.269856 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:53.271359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:53.272524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f5fc7322-c9d8-4687-8ed5-aea3249ec20d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.168319 Jul 01 19:55:53.273620 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 176/358] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:53 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:53.545918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:53.546535 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:53.554207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:53.554419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:53.555179 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:53.555619 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:53.688007 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:53.695409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cbaabc61-770b-443c-827b-5ad6a4a2910c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.153455 Jul 01 19:55:53.695962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 183/359] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:53 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:55:54.291705 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:54.292310 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:54.298910 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:54.299355 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:54.300166 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:54.300976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:54.436767 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:54.445876 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:54.447351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:54.448479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2f6f314e-8be2-4ad7-b79c-303375484fd1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.160721 Jul 01 19:55:54.449024 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 177/360] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:54 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:54.712089 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:54.713319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:54.719990 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:54.720741 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:54.721493 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:54.721960 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:54.852332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:54.859672 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-125ddc66-dc8c-49ba-8227-d97b3c398609 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.151449 Jul 01 19:55:54.860226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 184/361] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:54 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:55.466447 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:55.467130 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:55.473848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:55.474224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:55.483050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:55.483050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:55.622900 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:55.632200 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:55.633751 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:55.634906 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-de8d2fdf-83f1-4111-8e2a-1c9dee579173 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.172392 Jul 01 19:55:55.635469 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 178/362] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:55 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:55.877023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:55.877676 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:55.885453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:55.885944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:55.886711 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:55.887150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:56.235454 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:56.243832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6d254564-4f23-4102-8df0-0d713844af10 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.370671 Jul 01 19:55:56.244396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 185/363] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:55 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:56.653781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:56.654388 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:56.661713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:56.662163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:56.662921 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:56.663354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:56.790427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:56.798644 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:56.800133 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:56.801829 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-92e5a94d-b549-4f51-af5c-c87efbbc6db4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.152198 Jul 01 19:55:56.802372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 179/364] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:56 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:57.261005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:57.261757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:57.264935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:55:57.273186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:57.273832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:57.274840 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:57.275280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:57.408364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:57.415932 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c6304d87-92b0-48b8-9817-516d2809aefa tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.158798 Jul 01 19:55:57.416692 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 186/365] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:57 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:57.819636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:57.820233 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:57.826686 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:57.827127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:57.827871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:57.828295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:57.954331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:57.962665 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:57.964153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:57.965287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ce51f0c8-c983-4879-a1c8-cf20dcbbfcec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.149622 Jul 01 19:55:57.965879 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 180/366] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:57 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:58.432523 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:58.433121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:58.439581 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:58.440019 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:58.441310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:58.442284 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:58.574815 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:58.583060 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6b58cfe1-9d94-4a78-85fc-9f698d687050 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.154381 Jul 01 19:55:58.583614 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 187/367] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:58 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:55:58.984284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:58.984866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:58.992257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:58.992843 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:58.993621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:58.994058 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:59.128572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:59.137076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:59.138588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:59.139768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-269f6357-30dd-4662-a508-ad330b37ed5e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.159829 Jul 01 19:55:59.140322 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 181/368] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:55:58 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:55:59.600341 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:55:59.600952 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:55:59.607598 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:59.608048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:59.608807 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:55:59.609247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:55:59.742264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:55:59.749635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ad89b228-d88b-45a5-9725-d5e36f4f1b13 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.153556 Jul 01 19:55:59.750209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 188/369] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:55:59 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:00.158358 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:00.158868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:00.166175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:00.166621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:00.167370 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:00.167798 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:00.308898 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:00.317839 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:00.319628 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:00.320868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-10a61161-8325-4ca0-84c0-1fea9f3321f9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.166430 Jul 01 19:56:00.321557 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 182/370] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:00 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:00.767393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:00.768584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:00.776494 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:00.776933 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:00.777739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:00.778166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:00.910725 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:00.918141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1d712af2-9a95-4147-b56d-8cda74f3b447 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.155536 Jul 01 19:56:00.918708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 189/371] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:00 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:01.340231 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:01.340834 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:01.348160 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:01.348658 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:01.349424 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:01.350181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:01.493509 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:01.502715 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:01.504733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:01.506770 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e8f55243-05dd-4a12-881b-4e3a42b563de tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.170507 Jul 01 19:56:01.507403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 183/372] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:01 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:01.934790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:01.935412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:01.941824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:01.942328 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:01.943129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:01.943555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:02.081266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:02.089284 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-26983ffc-a1a6-46a2-ac8c-c49d100c0304 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.158290 Jul 01 19:56:02.089872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 190/373] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:01 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:02.525794 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:02.526476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:02.532500 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:02.532942 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:02.533723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:02.534158 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:02.665515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:02.674115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:02.675674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:02.677874 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1a3dc2d5-1b43-4fa0-9d6d-67c22d326244 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.157012 Jul 01 19:56:02.678560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 184/374] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:02 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:03.084019 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-de2498d8-8855-4a08-867a-b9d9eb5a209d req-a4526709-ff59-4e16-ac75-3ff319bf09a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "name": "network-vif-plugged", "status": "completed", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:03.092906 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-de2498d8-8855-4a08-867a-b9d9eb5a209d req-a4526709-ff59-4e16-ac75-3ff319bf09a8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:03.093472 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-de2498d8-8855-4a08-867a-b9d9eb5a209d req-a4526709-ff59-4e16-ac75-3ff319bf09a8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:03.105881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:03.106481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:03.112712 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:03.113146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:03.114052 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:03.115602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:03.123245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-de2498d8-8855-4a08-867a-b9d9eb5a209d req-a4526709-ff59-4e16-ac75-3ff319bf09a8 service nova] Creating event network-vif-plugged:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:56:03.129891 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-de2498d8-8855-4a08-867a-b9d9eb5a209d req-a4526709-ff59-4e16-ac75-3ff319bf09a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049306 Jul 01 19:56:03.130602 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 191/375] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:03.290555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:03.299871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-de2cdcb8-4980-43ec-8943-2f6a3eb1716c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.197418 Jul 01 19:56:03.300485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 185/376] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:03 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:56:03.696355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:03.697058 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:03.703908 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:03.704354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:03.705116 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:03.705546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:03.874488 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:03.883704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:03.885274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:03.886460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-560cc598-eb32-4517-81ed-e1d2ad804dbc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.194543 Jul 01 19:56:03.887020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 192/377] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:03 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:04.318941 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:04.319482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:04.326999 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:04.327449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:04.328209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:04.328642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:04.467408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:04.481866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bcb0726b-cf4f-42a3-a4c7-8b6450ccd517 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.167480 Jul 01 19:56:04.482468 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 186/378] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:04 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:04.904900 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:04.905495 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:04.912769 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:04.913219 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:04.914029 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:04.914467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:05.126746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:05.135941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:05.137425 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:05.138634 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7814fc5d-2b43-430e-b581-4935ef0b07dc tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.237694 Jul 01 19:56:05.150719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 193/379] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:04 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:05.151039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-42f96c51-adf0-486d-af48-70b185a59411 req-6994048e-8aa5-4864-b455-8f664fc88545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdbc8c7-9db6-4914-8ad4-b55ee6460761", "name": "network-vif-plugged", "status": "completed", "tag": "f9cbac97-cb1e-4639-8812-c364aa6fa31d"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:05.157496 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-42f96c51-adf0-486d-af48-70b185a59411 req-6994048e-8aa5-4864-b455-8f664fc88545 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:05.158052 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-42f96c51-adf0-486d-af48-70b185a59411 req-6994048e-8aa5-4864-b455-8f664fc88545 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:05.162827 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:05.171852 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-42f96c51-adf0-486d-af48-70b185a59411 req-6994048e-8aa5-4864-b455-8f664fc88545 service nova] Creating event network-vif-plugged:f9cbac97-cb1e-4639-8812-c364aa6fa31d for instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 on hv-cinder-84460 Jul 01 19:56:05.177760 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-42f96c51-adf0-486d-af48-70b185a59411 req-6994048e-8aa5-4864-b455-8f664fc88545 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033162 Jul 01 19:56:05.178363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 187/380] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:05.500015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:05.500684 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:05.508790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:05.509456 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:05.510429 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:05.511025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:05.769245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:05.783602 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3c0056f1-c342-455d-b81d-fdfada165057 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.287087 Jul 01 19:56:05.788242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 194/381] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:05 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:06.175871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:06.179407 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:06.198807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:06.199922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:06.201530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:06.202941 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:06.449425 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:06.464254 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:06.499308 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:06.514009 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-baa5e4b5-c1ae-4de7-9c17-d61811d46bdb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1810 microversion: 2.20 time: 0.357435 Jul 01 19:56:06.524891 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 188/382] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:06 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1810 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:06.803336 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:06.804514 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:06.814232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:06.814881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:06.815801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:06.816384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:07.049403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:07.057431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-aaa0bcb4-7bd3-4619-8fa1-d9ac24fe53ac tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1267 microversion: 2.1 time: 0.259493 Jul 01 19:56:07.058026 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 195/383] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:06 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:07.543070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:07.543670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:07.552307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:07.552755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:07.553530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:07.554017 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:07.701050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:07.713535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:07.716092 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:07.718138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bec76cbf-f126-4d5d-b224-5908bf9a74a2 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1797 microversion: 2.20 time: 0.178855 Jul 01 19:56:07.719614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 189/384] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:07 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1797 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:56:08.074446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:08.075159 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:08.081751 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:08.082207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:08.090304 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:08.090761 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:08.254694 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:08.267384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9b107f28-1978-4e44-903c-3b98d637c412 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1453 microversion: 2.1 time: 0.196669 Jul 01 19:56:08.268506 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 196/385] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:08 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1453 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:08.292923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:08.293897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:08.303067 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:08.304118 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:08.305128 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:08.305817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:08.485731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:08.509102 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dced4dfa-3538-4330-a95d-c9b5bf136bea tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1453 microversion: 2.1 time: 0.223965 Jul 01 19:56:08.511588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 190/386] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:08 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1453 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:11.234133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-916845dd-b267-4e9f-a136-dfef6af1a2d8 req-f333048a-1dff-483e-8ee1-c148ede23778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abdbc8c7-9db6-4914-8ad4-b55ee6460761", "tag": "f9cbac97-cb1e-4639-8812-c364aa6fa31d"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:11.249591 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-916845dd-b267-4e9f-a136-dfef6af1a2d8 req-f333048a-1dff-483e-8ee1-c148ede23778 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:11.250290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-916845dd-b267-4e9f-a136-dfef6af1a2d8 req-f333048a-1dff-483e-8ee1-c148ede23778 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:11.263973 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-916845dd-b267-4e9f-a136-dfef6af1a2d8 req-f333048a-1dff-483e-8ee1-c148ede23778 service nova] Creating event network-changed:f9cbac97-cb1e-4639-8812-c364aa6fa31d for instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 on hv-cinder-84460 Jul 01 19:56:11.269816 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-916845dd-b267-4e9f-a136-dfef6af1a2d8 req-f333048a-1dff-483e-8ee1-c148ede23778 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043440 Jul 01 19:56:11.271352 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 197/387] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:14.194883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:14.195592 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:14.235814 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=50 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:14.251343 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:14.255307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:14.256539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:14.257786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:14.592149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lazy-loading 'services' on Instance uuid c1a80874-00ef-4d4b-8ef0-7a604ed7458e {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:56:14.790057 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-15a09bff-a161-424c-86c3-d52bf937ee4d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-volume_attachments/852b782d-2da1-4bcc-89c1-6bb2b48ecf42" status: 202 len: 0 microversion: 2.1 time: 0.601768 Jul 01 19:56:14.791957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 191/388] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:56:14 2022] DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-volume_attachments/852b782d-2da1-4bcc-89c1-6bb2b48ecf42 => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:56:16.042053 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-01a2fb34-fa32-4839-8d1e-6d181bf44041 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:16.058683 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-01a2fb34-fa32-4839-8d1e-6d181bf44041 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:16.059526 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-01a2fb34-fa32-4839-8d1e-6d181bf44041 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:16.116516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-01a2fb34-fa32-4839-8d1e-6d181bf44041 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Going to try to stop instance {{(pid=124287) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 01 19:56:16.184979 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-01a2fb34-fa32-4839-8d1e-6d181bf44041 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action" status: 202 len: 0 microversion: 2.1 time: 0.147982 Jul 01 19:56:16.186118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 198/389] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:56:16 2022] POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:56:16.195792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:16.196486 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:16.211661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:16.212111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:16.220726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:16.221464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:16.694131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:16.705360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ceb1a281-10ac-4784-b849-8bb683b46f91 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.515259 Jul 01 19:56:16.706822 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 192/390] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:16 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:17.726588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:17.728123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:17.743020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:17.743713 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:17.744482 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:17.744909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:17.749494 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:17.968658 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:17.981099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f09a635f-95a4-4dbb-bd09-d6eb7bec02cd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.261309 Jul 01 19:56:17.982696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 199/391] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:17 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:19.004979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:19.006286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:19.019418 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:19.020363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:19.022084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:19.022532 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:19.272133 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:19.281799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-435d856c-0962-454b-937d-77c1ad07921e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.282268 Jul 01 19:56:19.283201 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 193/392] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:18 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:20.299703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:20.304130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:20.321443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:20.322197 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:20.322972 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:20.323407 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:20.527997 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:20.536926 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c8d91a10-a37e-4b94-8105-ca9cec105202 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.241305 Jul 01 19:56:20.541987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 200/393] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:20 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:21.560818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:21.561437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:21.578125 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:21.578572 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:21.579352 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:21.579779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:21.805563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:21.814051 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7566c0d7-cce8-4c64-8443-d177e0fb45e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.258975 Jul 01 19:56:21.815149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 194/394] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:21 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:22.832548 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:22.833918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:22.844349 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:22.845099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:22.846160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:22.846852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:23.065236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:23.074247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ee8d0129-2706-45e9-80ee-5149be206dc2 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.246068 Jul 01 19:56:23.075967 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 201/395] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:22 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:24.091947 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:24.093269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:24.100427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:24.100877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:24.101744 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:24.102181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:24.246707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:24.255594 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ffd216de-0ff4-4370-8737-650edc484dd5 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.167294 Jul 01 19:56:24.256747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 195/396] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:24 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:25.276625 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:25.277150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:25.284367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:25.285653 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:25.286920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:25.287358 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:25.432277 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:25.440488 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d998e81d-42e4-458b-b967-d77e4e90fae1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.169624 Jul 01 19:56:25.442676 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 202/397] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:25 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:26.458771 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:26.459456 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:26.467866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:26.468322 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:26.469111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:26.469551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:26.560927 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de6728d5-707e-4911-a724-f1748cce597e"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:26.562251 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:26.570206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:26.570849 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:26.571759 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:26.572293 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:26.657357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:26.665834 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2339043e-0b40-4096-a287-f00f9dc99767 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1678 microversion: 2.1 time: 0.211758 Jul 01 19:56:26.668938 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 196/398] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:26 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1678 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:26.671112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c1bf25ac-8c14-45ba-af8c-c30d89661c36 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Action: 'create', calling method: .version_select at 0x7fa0077734c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1416444649", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNikvQ/T/XN1vlCeihxHQRi55XlCSjvDyIJSah8mF4ySKOKNQd2yqEBBQTYpadn88w2dilWo1YUZxImYpuiT5M+hEfMAei9hKwHYVgborR3qb88iAK8EdrgwrJxyNnaSw=="}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:26.685673 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-c1bf25ac-8c14-45ba-af8c-c30d89661c36 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Getting quotas for project e33de0b0c3244c78a86fbfda1c9fbdd6. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:56:26.689499 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-c1bf25ac-8c14-45ba-af8c-c30d89661c36 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Getting quotas for user d4ef9ec1904d4e76ae1cd1dc197e4f41 and project e33de0b0c3244c78a86fbfda1c9fbdd6. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:56:26.713071 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c1bf25ac-8c14-45ba-af8c-c30d89661c36 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045455 Jul 01 19:56:26.713612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 197/399] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:56:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:26.814230 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-927138999", "imageRef": "080c9751-360a-40fb-bd05-d2e9df9a5506", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1416444649", "networks": [{"uuid": "278aa73b-8d63-4a59-a3b7-723c6888fb9e"}]}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:26.827246 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f31c4d7e-f271-49d1-b713-a920ce7b06a4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270034 Jul 01 19:56:26.827963 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 203/400] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:56:26 2022] POST /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:26.872594 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] validate_networks() for [('278aa73b-8d63-4a59-a3b7-723c6888fb9e', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:56:27.282406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:56:27.282921 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:56:27.283438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:56:27.283945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:56:27.284474 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:56:27.294736 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.295190 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:27.295990 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.296557 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:27.315169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Getting quotas for project e33de0b0c3244c78a86fbfda1c9fbdd6. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:56:27.319925 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Getting quotas for user d4ef9ec1904d4e76ae1cd1dc197e4f41 and project e33de0b0c3244c78a86fbfda1c9fbdd6. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:56:27.331160 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:56:27.334091 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='080c9751-360a-40fb-bd05-d2e9df9a5506',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:56:27.381329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1332e256-f4b5-49ce-9833-219da5085b3f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.571359 Jul 01 19:56:27.382241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 198/401] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 01 19:56:27.393565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-53fdd709-63fd-4432-acde-ba4c59f71e51 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:27.395043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-53fdd709-63fd-4432-acde-ba4c59f71e51 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:27.397461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=36 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:27.454921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-53fdd709-63fd-4432-acde-ba4c59f71e51 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:27.463048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-53fdd709-63fd-4432-acde-ba4c59f71e51 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1258 microversion: 2.1 time: 0.074217 Jul 01 19:56:27.463629 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 204/402] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:27 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1258 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:27.684381 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:27.685237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:27.693473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.693949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:27.695247 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.695801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:27.843940 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:27.852601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-414995ef-129a-43e4-804c-f078107697c7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1655 microversion: 2.1 time: 0.172995 Jul 01 19:56:27.853355 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 199/403] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:27 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1655 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:27.876031 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4ca86b11-4519-4b35-856d-ab8663ea544b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:27.885088 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4ca86b11-4519-4b35-856d-ab8663ea544b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.885545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4ca86b11-4519-4b35-856d-ab8663ea544b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:27.909464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4ca86b11-4519-4b35-856d-ab8663ea544b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Going to try to start instance {{(pid=124287) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 01 19:56:27.965076 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4ca86b11-4519-4b35-856d-ab8663ea544b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action" status: 202 len: 0 microversion: 2.1 time: 0.099029 Jul 01 19:56:27.965708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 205/404] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:56:27 2022] POST /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:56:27.975782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:27.977041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:27.984119 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.985316 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:27.986139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:27.986758 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:28.160415 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:28.168163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dcc0eea5-ee0e-47b5-be3a-1f2adfee692c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.197227 Jul 01 19:56:28.168737 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 200/405] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:27 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:28.481880 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:28.482770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:28.490548 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:28.491314 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:28.492193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:28.492746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:28.579310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:28.589038 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-48e33b65-e813-4cab-b1fc-375a8e53a148 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1318 microversion: 2.1 time: 0.111709 Jul 01 19:56:28.589909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 206/406] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:28 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:29.186259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:29.187447 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:29.207526 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:29.207995 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:29.208784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:29.209225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:29.435581 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:29.454714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d4f33e32-6dea-4220-a5ae-ff9a17fdb5ec tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.272234 Jul 01 19:56:29.455921 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 201/407] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:29 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:29.608220 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:29.609649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:29.618288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:29.620154 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:29.621163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:29.621830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:29.770076 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:29.777559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ab0895f8-bef9-4438-9d7f-3a2b13556947 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.174390 Jul 01 19:56:29.778137 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 207/408] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:29 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:30.473766 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:30.475611 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:30.482623 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:30.483109 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:30.483867 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:30.484298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:30.625218 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:30.633869 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7c49a34e-c7c8-4e1a-9295-165ac75e7566 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.164621 Jul 01 19:56:30.634443 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 202/409] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:30 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:30.795655 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:30.796202 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:30.804372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:30.805061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:30.806067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:30.806726 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:30.944135 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:30.952647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4da74e1f-573a-42ad-abfd-54e7501aed59 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.160908 Jul 01 19:56:30.953442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 208/410] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:30 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:31.652092 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:31.653558 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:31.660959 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:31.661798 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:31.662821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:31.663490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:31.793668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:31.801545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-da2184d6-b7f6-441d-9597-e2d2b3e94621 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.153863 Jul 01 19:56:31.802125 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 203/411] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:31 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:31.970968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:31.974340 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:31.982252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:31.982786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:31.983775 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:31.984272 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:32.139377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:32.149203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5bfa8fec-bdd2-4f4f-8db2-5ca67e9b2eb0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.182825 Jul 01 19:56:32.150163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 209/412] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:31 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:32.824173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:32.824796 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:32.832569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:32.833009 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:32.833805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:32.834240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:33.003480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:33.011612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cd0b8aab-6bd9-4822-bfde-ed2d637d8599 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.196580 Jul 01 19:56:33.012284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 204/413] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:32 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:33.166051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:33.166684 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:33.173233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:33.173716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:33.174474 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:33.174968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:33.324588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:33.332597 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-67e13a5c-02b1-4d22-9dd1-fe67661ea550 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.170289 Jul 01 19:56:33.333100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 210/414] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:33 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:34.030870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:34.032326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:34.041089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:34.041638 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:34.042470 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:34.042965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:34.064161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:34.185376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:34.194439 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-34a16dc6-e460-4617-83d5-2ef6baef349d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.167656 Jul 01 19:56:34.195289 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 205/415] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:34 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:34.350045 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:34.351312 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:34.358553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:34.359228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:34.360185 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:34.360784 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:34.506391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:34.514758 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8c350e9d-919d-46eb-8325-77f857970e98 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.169137 Jul 01 19:56:34.515471 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 211/416] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:34 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:35.213605 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:35.214175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:35.221154 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:35.222042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:35.223229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:35.223771 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:35.385944 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:35.400621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ad11616c-0a06-4894-b5c5-20102109d277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.190891 Jul 01 19:56:35.401214 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 206/417] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:35 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:35.532853 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:35.533431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:35.540715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:35.541165 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:35.542164 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:35.542605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:35.682026 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:35.695608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5ef4cff4-c8c3-461f-93ef-ce357f8e25cd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.166298 Jul 01 19:56:35.698448 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 212/418] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:35 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:36.418421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:36.419657 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:36.426911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:36.427457 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:36.428294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:36.428944 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:36.586490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:36.594612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6e34c372-3d0f-4a68-a63f-d3db169f589d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.179942 Jul 01 19:56:36.595182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 207/419] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:36 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:36.715048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:36.715617 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:36.722067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:36.722512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:36.723264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:36.723698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:36.860889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:36.868761 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f2e28cce-49f8-443e-8e81-6ba3563c78eb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.157592 Jul 01 19:56:36.869344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 213/420] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:36 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:37.612317 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:37.612934 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:37.614830 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:37.615701 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=10 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:37.623023 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:37.623449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:37.624215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:37.624646 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:37.799262 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:37.808477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c7493601-62df-4845-9622-2d62f7dd12b1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.199967 Jul 01 19:56:37.809073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 208/421] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:37 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:37.887077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:37.888014 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:37.895428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:37.897854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:37.898301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:37.899415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:37.899911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:37.920494 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:38.038172 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:38.045533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b61d823b-b48e-41b9-be02-8a28d9c755fa tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.162737 Jul 01 19:56:38.046120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 214/422] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:37 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:38.826497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:38.827302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:38.834061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:38.834513 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:38.835302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:38.835741 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:38.969840 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:38.977339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ac501438-1742-44f7-aebc-d38afed60fea tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1664 microversion: 2.1 time: 0.154733 Jul 01 19:56:38.977939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 209/423] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:38 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:39.062974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:39.063666 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:39.072956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:39.073399 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:39.074191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:39.074626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:39.211671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:39.219120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d2934121-0736-4f18-9f73-12fdd496f276 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.160229 Jul 01 19:56:39.219680 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 215/424] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:39 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:39.669228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-0b315a9e-57d5-45cf-8efb-96fd8a6ac242 req-2f7668ef-ce19-4995-afc8-a27f1a43f232 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:39.679439 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-0b315a9e-57d5-45cf-8efb-96fd8a6ac242 req-2f7668ef-ce19-4995-afc8-a27f1a43f232 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:39.679965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-0b315a9e-57d5-45cf-8efb-96fd8a6ac242 req-2f7668ef-ce19-4995-afc8-a27f1a43f232 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:39.693101 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-0b315a9e-57d5-45cf-8efb-96fd8a6ac242 req-2f7668ef-ce19-4995-afc8-a27f1a43f232 service nova] Creating event network-changed:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:56:39.698187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-0b315a9e-57d5-45cf-8efb-96fd8a6ac242 req-2f7668ef-ce19-4995-afc8-a27f1a43f232 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032577 Jul 01 19:56:39.698790 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 210/425] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:39.994363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:39.994972 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:40.000924 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.001361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.002150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.002602 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.133347 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:40.140884 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ec4b388e-6378-48f3-9704-5ee7b6be7905 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1668 microversion: 2.1 time: 0.150449 Jul 01 19:56:40.141383 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 216/426] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:39 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:40.237241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:40.237943 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:40.244112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.244556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.245304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.245768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.389439 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:40.398379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bc27b873-2e43-40d9-a52b-e28f7eee9a2b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.165892 Jul 01 19:56:40.405521 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 211/427] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:40 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:40.727922 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:40.728930 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:40.735027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.735477 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.736268 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.736706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.760281 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lazy-loading 'flavor' on Instance uuid 527d64b8-42ce-4ab0-9256-f6dae97073d7 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:56:40.883416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-39562552-ca48-4e0e-9173-9f8add7ff383 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/action" status: 200 len: 32 microversion: 2.1 time: 0.159444 Jul 01 19:56:40.884086 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 217/428] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:56:40 2022] POST /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:56:40.893613 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:40.894434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:40.901745 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.902464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:40.904190 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:40.904931 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:41.037018 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:41.046915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-db676be0-e722-481a-a34a-bc4b8b997583 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.157195 Jul 01 19:56:41.047473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 212/429] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:40 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:41.418971 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:41.419705 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:41.426954 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:41.427398 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:41.428191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:41.428623 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:41.561144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:41.569237 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7a6336df-d5fb-4f6e-85a9-a000b07850be tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.155154 Jul 01 19:56:41.569827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 218/430] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:41 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:42.066198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:42.066935 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:42.073535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:42.074021 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:42.074794 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:42.075231 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:42.206506 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:42.214731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3239a88f-90db-4516-9d57-6c9c678b7602 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.152476 Jul 01 19:56:42.215292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 213/431] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:42 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:42.586425 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:42.587035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:42.593612 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:42.594063 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:42.594814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:42.595244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:42.725912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:42.733161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b1bfa34e-27df-4610-812f-cf6256d3a37b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.150588 Jul 01 19:56:42.733748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 219/432] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:42 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:43.232647 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:43.233363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:43.240879 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.241326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.242118 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.242585 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.380474 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:43.390057 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8217ff93-2848-4463-ae63-2f3deb47d592 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.161251 Jul 01 19:56:43.390672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 214/433] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:43 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:43.750772 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:43.751386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:43.758012 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.758476 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.759427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:43.759907 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:43.894348 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:43.901868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7e7cf629-130b-49a6-a7be-a74c917cac9d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.155135 Jul 01 19:56:43.902436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 220/434] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:43 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:44.407617 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:44.408217 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:44.410766 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:44.416025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:44.416474 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:44.417240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:44.417700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:44.553261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:44.561176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3362eaa4-2176-4214-88eb-ca558c095dd8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.157454 Jul 01 19:56:44.561764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 215/435] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:44 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:44.919193 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:44.919804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:44.926577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:44.927029 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:44.927787 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:44.928219 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:45.057354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:45.064785 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cbf384ca-6433-4981-b670-9dae85230d67 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.149451 Jul 01 19:56:45.066100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 221/436] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:44 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:45.359345 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-2757886e-1c7c-4343-bb79-cb6c9aa11231 req-2dc2f964-7489-45fe-99c3-67938b3f88e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "name": "network-vif-plugged", "status": "completed", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:45.368138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-2757886e-1c7c-4343-bb79-cb6c9aa11231 req-2dc2f964-7489-45fe-99c3-67938b3f88e0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:45.368576 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-2757886e-1c7c-4343-bb79-cb6c9aa11231 req-2dc2f964-7489-45fe-99c3-67938b3f88e0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:45.381360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-2757886e-1c7c-4343-bb79-cb6c9aa11231 req-2dc2f964-7489-45fe-99c3-67938b3f88e0 service nova] Creating event network-vif-plugged:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:56:45.386621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-2757886e-1c7c-4343-bb79-cb6c9aa11231 req-2dc2f964-7489-45fe-99c3-67938b3f88e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030766 Jul 01 19:56:45.387539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 216/437] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:45.578415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:45.579027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:45.584999 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:45.585441 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:45.586254 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:45.586715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:45.713879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:45.722644 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c781ba83-f67c-44b4-a98b-e4ed62cef8e3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.148072 Jul 01 19:56:45.723206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 222/438] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:45 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:46.083878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:46.084563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:46.091285 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.091721 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.092462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.092892 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.225871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:46.233510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5d0bcef3-5e0e-47f7-bc5a-d6487669e4b2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.154814 Jul 01 19:56:46.234099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 217/439] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:46 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:46.739825 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:46.740435 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:46.746903 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.747351 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.748114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:46.748549 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:46.877231 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:46.885736 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-826f8818-c1d6-46e4-892d-eaf0928f0e66 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.150405 Jul 01 19:56:46.886312 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 223/440] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:46 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:47.250385 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:47.250997 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:47.258026 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.258472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:47.259223 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.259657 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:47.395533 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:47.403194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-13706707-5258-476f-9829-c626ac732bc2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1358 microversion: 2.1 time: 0.156717 Jul 01 19:56:47.403757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 218/441] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:47 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:47.903569 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:47.904170 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:47.911672 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.912137 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:47.912889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:47.913319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.041052 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:48.048854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b11fa50f-908f-49e1-893c-a892e89dbe13 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.149297 Jul 01 19:56:48.050198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 224/442] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:47 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:48.420075 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:48.420681 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:48.427366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.427810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.428636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.429066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.558954 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:48.567216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-248ebe60-f2a2-4365-81d7-7ea2d339ab42 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1548 microversion: 2.1 time: 0.151026 Jul 01 19:56:48.567788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 219/443] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:48 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:48.583436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:48.584036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:48.591659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.592424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.593776 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.594536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.724922 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:48.732365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-fd08aae6-b9b8-4a82-bbf6-4dd2ea8c4a14 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1548 microversion: 2.1 time: 0.153200 Jul 01 19:56:48.732915 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 225/444] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:48 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:48.749096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:48.752517 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:48.753274 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Searching by: {'deleted': False, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6'} {{(pid=124286) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 01 19:56:48.759916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.760360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.761146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.761605 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.849868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.multi_cell_list [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124286) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 01 19:56:48.948051 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1e969c55-b7f2-4181-8b33-382f2f8c10cf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202621 Jul 01 19:56:48.948556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 220/445] 10.222.0.66 () {58 vars in 1124 bytes} [Fri Jul 1 19:56:48 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:48.959442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:48.960061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:48.966640 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.967095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:48.967854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:48.968291 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.049329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:49.049878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:49.055960 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.056400 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.057187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.057621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.087058 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0002e125-6a67-4477-9cad-bc46293ea0ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments/94383c7c-73ef-4696-aa4c-442eeea784ae" status: 200 len: 194 microversion: 2.20 time: 0.041759 Jul 01 19:56:49.087662 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 221/446] 10.222.0.66 () {60 vars in 1453 bytes} [Fri Jul 1 19:56:49 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments/94383c7c-73ef-4696-aa4c-442eeea784ae => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:56:49.097362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:49.098878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:49.100814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:49.105033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.105484 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.106347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.106784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.109121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-14d8d0e0-9981-48db-9531-6c8b07bfaf57 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1548 microversion: 2.1 time: 0.153948 Jul 01 19:56:49.109896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 226/447] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:48 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:49.159662 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:49.160957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:49.167321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.167766 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.168532 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.168962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.245880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:49.255148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1e03408b-1078-4f47-bcf4-74db40f86057 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.161585 Jul 01 19:56:49.255916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 222/448] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:49 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:49.299527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lazy-loading 'services' on Instance uuid 4fe1a243-f161-4e1a-ada3-d5ef02346b96 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:56:49.440050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-05ea28e7-5861-4680-9a26-dfad330b322c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments/94383c7c-73ef-4696-aa4c-442eeea784ae" status: 202 len: 0 microversion: 2.20 time: 0.284669 Jul 01 19:56:49.441621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 227/449] 10.222.0.66 () {60 vars in 1456 bytes} [Fri Jul 1 19:56:49 2022] DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments/94383c7c-73ef-4696-aa4c-442eeea784ae => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:56:49.449408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:49.450430 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:49.457895 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.459186 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.460400 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:49.460945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:49.465452 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:49.494049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ee9f0593-c6c0-44bb-8cb1-10cf703f5761 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048550 Jul 01 19:56:49.495069 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 223/450] 10.222.0.66 () {60 vars in 1342 bytes} [Fri Jul 1 19:56:49 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:56:50.275109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:50.276394 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:50.284405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.285539 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.286406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.286844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.307699 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:50.435048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:50.443350 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4fdb826e-5ab9-4674-ab10-e37c1f3f5d27 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.174524 Jul 01 19:56:50.443925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 228/451] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:50 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:50.506464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:50.507412 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:50.517048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.517500 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.518296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.518730 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.556871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d96a5c71-33f0-47dc-9bc2-83bfb310f3ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054401 Jul 01 19:56:50.557460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 224/452] 10.222.0.66 () {60 vars in 1342 bytes} [Fri Jul 1 19:56:50 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:50.620226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:50.620720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:50.626884 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.627098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.627851 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.628295 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.654804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:56:50.699987 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbbf0184-6d55-4425-bade-9dfa3824aca2"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:50.701320 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:50.709503 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.710257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.711038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.711477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.755862 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-12448120-2f4c-455e-b3c5-b86331127f0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 204 len: 0 microversion: 2.20 time: 0.141173 Jul 01 19:56:50.756958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 229/453] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 1 19:56:50 2022] DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 01 19:56:50.766078 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:50.766775 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:50.773802 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.774247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.774997 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:50.775426 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:50.911429 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:50.919430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:50.920968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:50.922144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-28583bd7-5002-4dad-959a-59a87eb3ec3f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.160559 Jul 01 19:56:50.922707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 230/454] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:50 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:51.460347 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:51.460963 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:51.467467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:51.467914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:51.468673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:51.469145 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:51.596637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:51.604507 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0409a795-b91c-4419-a376-e13b8bb1fbc9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.148130 Jul 01 19:56:51.605077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 231/455] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:51 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:56:51.940379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:51.941028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:51.947105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:51.947553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:51.948310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:51.948751 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:52.077441 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:52.086426 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:52.087896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:52.089016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bb54fadf-7b4b-4df4-b918-b5ebdd28997d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.152634 Jul 01 19:56:52.089565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 232/456] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:51 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:56:52.377260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b3425088-37d0-4261-8dbc-d7e6f5bc13cc tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.681229 Jul 01 19:56:52.378072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 225/457] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:56:50 2022] POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments => generated 194 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:56:52.622092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:52.622737 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:52.629859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:52.630301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:52.631049 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:52.631480 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:52.767244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:52.775751 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0250e75c-b321-4484-9aa0-88848c01d989 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.157438 Jul 01 19:56:52.776308 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 233/458] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:52 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:53.108812 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:53.109510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:53.116709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:53.117153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:53.117943 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:53.118408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:53.258172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:53.266967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:53.268592 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:53.269897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-25eb7451-e45d-449c-9596-53bd439007a0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1725 microversion: 2.20 time: 0.165808 Jul 01 19:56:53.271725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 226/459] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:53 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:53.793376 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:53.794620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:53.802536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:53.802905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:53.803694 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:53.804127 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:53.940893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:53.949949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1c7ab8be-916d-4741-9b2d-34c6cb15a5b6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.160893 Jul 01 19:56:53.950533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 234/460] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:53 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:54.096463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-9ccb52ad-6d50-4d95-9f29-d5d14da5a085 req-666fa697-608e-46b9-8bf8-a0c1d2013e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fe1a243-f161-4e1a-ada3-d5ef02346b96", "name": "network-vif-deleted", "tag": "93dfc642-870b-4bec-b7c3-31efe44f78c4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:54.106551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9ccb52ad-6d50-4d95-9f29-d5d14da5a085 req-666fa697-608e-46b9-8bf8-a0c1d2013e4c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.107094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9ccb52ad-6d50-4d95-9f29-d5d14da5a085 req-666fa697-608e-46b9-8bf8-a0c1d2013e4c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.120163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-9ccb52ad-6d50-4d95-9f29-d5d14da5a085 req-666fa697-608e-46b9-8bf8-a0c1d2013e4c service nova] Creating event network-vif-deleted:93dfc642-870b-4bec-b7c3-31efe44f78c4 for instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 on hv-cinder-84460 Jul 01 19:56:54.125013 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-9ccb52ad-6d50-4d95-9f29-d5d14da5a085 req-666fa697-608e-46b9-8bf8-a0c1d2013e4c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033171 Jul 01 19:56:54.128599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 227/461] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:56:54.290667 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:54.291273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:54.297177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.297645 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.298401 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.298831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.332124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.332584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.333988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lazy-loading 'fault' on Instance uuid 4fe1a243-f161-4e1a-ada3-d5ef02346b96 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:56:54.380331 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:54.388928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:54.390526 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:54.391745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-737ec1de-2c7b-4d22-a538-c412aa29e22e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 200 len: 1372 microversion: 2.20 time: 0.106264 Jul 01 19:56:54.392386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 235/462] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:54 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:54.968241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:54.969183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:54.979461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.979901 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:54.980664 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:54.981089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:55.129242 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:55.138059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d6edc757-4a06-4733-9644-6aa94398f1f5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.174580 Jul 01 19:56:55.138658 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 228/463] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:54 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:55.410479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:55.411608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:55.417636 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:55.418089 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:55.418881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:55.419313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:55.432737 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] HTTP exception thrown: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Request method failure captured: Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 HTTP/1.1 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CUTtCUlOrvsuEbpRVe7KfqcssFKv9MhQLSuJimsccSd_BZZP-V3BZizkFIK3VloxX2R9PUE4oMzLTWewZHLfcN8tU7XHXzpwKJcrFXkbWbNdKeFHghtxXDsgFSWhLET4MhJgpjUrndw5J4KNCtiuZ60qgpMlaKHdSXXbfXML376rc Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:56:55.434427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3307be3159654f55be46e75c82584bf0 Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:56:55.436119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '4fe1a243-f161-4e1a-ada3-d5ef02346b96'} Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:56:55.440296 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:56:55.441755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:56:55.444166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Returning 404 to user: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:56:55.444166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-93b93871-f621-44c6-b6e3-0b1bfde0b976 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 404 len: 111 microversion: 2.20 time: 0.029315 Jul 01 19:56:55.444166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 236/464] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:55 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:56:55.449380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8fe0a457-49e6-474f-9647-2ae662eadd38 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '.version_select at 0x7fa0075c5670>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:55.469290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8fe0a457-49e6-474f-9647-2ae662eadd38 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293309274" status: 204 len: 0 microversion: 2.20 time: 0.023542 Jul 01 19:56:55.469911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 229/465] 10.222.0.66 () {60 vars in 1261 bytes} [Fri Jul 1 19:56:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1293309274 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 19:56:56.156361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:56.157358 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:56.164784 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:56.165223 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:56.166159 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:56.166647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:56.198741 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-055c5794-11bd-40f6-98af-b4c2aa72668b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'create', calling method: .version_select at 0x7fa0074db8b0>, body: {"keypair": {"name": "tempest-keypair-609899576", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6u1rMwGnAieXqppxLRzDcgwFORZaWWpBvE8AzsP+LjoPR5550yD7xpRbK3WfadO52NVobbjUgRT2gobuOZdTlGnOvx+FHE+r70BQbzyeCA4v53bFR0ObGH8YOnIHDI8Q=="}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:56.215547 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-055c5794-11bd-40f6-98af-b4c2aa72668b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:56:56.219479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-055c5794-11bd-40f6-98af-b4c2aa72668b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for user 3307be3159654f55be46e75c82584bf0 and project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:56:56.244093 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-055c5794-11bd-40f6-98af-b4c2aa72668b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.052355 Jul 01 19:56:56.249818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 230/466] 10.222.0.66 () {62 vars in 1199 bytes} [Fri Jul 1 19:56:56 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 01 19:56:56.316947 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:56.326771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8d6511a5-b867-46eb-8f52-f8ecc03d4de4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.174376 Jul 01 19:56:56.339115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 237/467] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:56 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:56:57.346987 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:57.347529 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:57.354519 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:57.355046 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:57.355858 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:57.356300 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:57.555012 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:57.563056 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-61fe68f2-e8dd-414e-846b-e1d22164785c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.220491 Jul 01 19:56:57.563622 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 231/468] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:57 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:57.850687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2897821", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7e9d88c7-2969-402f-b3c2-096acc062b79"}], "security_groups": [{"name": "tempest-securitygroup--1104655496"}], "key_name": "tempest-keypair-609899576", "user_data": "}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:56:57.857826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:57.953298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] validate_networks() for [('7e9d88c7-2969-402f-b3c2-096acc062b79', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:56:58.318269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:56:58.318698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:56:58.319175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:56:58.319585 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:56:58.319994 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:56:58.329087 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:58.329533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:58.330358 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:58.330795 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:58.347651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:56:58.352217 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Getting quotas for user 3307be3159654f55be46e75c82584bf0 and project b8e38ec3f92a47fe98829eb3d289cdb4. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:56:58.362910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:56:58.365756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:56:58.414352 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-884074c3-ae74-45fa-b061-8f9022bdbd04 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.568362 Jul 01 19:56:58.414941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 238/469] 10.222.0.66 () {62 vars in 1187 bytes} [Fri Jul 1 19:56:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 01 19:56:58.425150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-50fdd912-7e6e-480a-a01c-2984dc7b0a86 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:58.425894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-50fdd912-7e6e-480a-a01c-2984dc7b0a86 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:58.482494 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-50fdd912-7e6e-480a-a01c-2984dc7b0a86 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:58.490756 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-50fdd912-7e6e-480a-a01c-2984dc7b0a86 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:58.492266 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-50fdd912-7e6e-480a-a01c-2984dc7b0a86 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:58.493404 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-50fdd912-7e6e-480a-a01c-2984dc7b0a86 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1278 microversion: 2.20 time: 0.072410 Jul 01 19:56:58.503539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 232/470] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:58 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1278 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:56:58.580016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:58.580620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:58.587486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:58.587935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:58.588857 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:58.589289 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:58.730638 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:58.740217 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a135796f-b328-441e-94a7-54d689ebf28a tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.164010 Jul 01 19:56:58.740795 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 239/471] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:58 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:56:59.511181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:59.511777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:59.513757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:56:59.521312 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:59.521799 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:59.522548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:59.522978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:59.589909 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:59.601545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:59.603124 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:59.604234 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ffd43bb6-a27e-463f-9125-43666d1647be tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1274 microversion: 2.20 time: 0.096955 Jul 01 19:56:59.604801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 233/472] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:56:59 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:56:59.757035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:56:59.757683 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:56:59.764218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:59.764651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:59.765408 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:56:59.765879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:56:59.897459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:56:59.905895 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-923eec2a-e167-47b6-99bc-1f30cdebd7d5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.152690 Jul 01 19:56:59.906364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 240/473] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:56:59 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:00.622951 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:00.623564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:00.630730 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:00.631179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:00.631969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:00.632406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:00.699201 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:00.707127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:00.709313 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:00.710428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-269f3c0d-6ab8-4957-87a5-7fa17b4317eb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1330 microversion: 2.20 time: 0.091614 Jul 01 19:57:00.710982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 234/474] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:00 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1330 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:57:00.924749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:00.925430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:00.932151 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:00.932746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:00.933614 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:00.934183 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.083947 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:01.093155 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-566c176c-2b18-4017-bed1-0a5ccd3e6720 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1735 microversion: 2.1 time: 0.174240 Jul 01 19:57:01.097555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 241/475] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:00 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:01.102182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:01.102967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:01.110184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:01.110627 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.111384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:01.111847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.248354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:01.256406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ad1f8eec-fb94-4367-a1e7-30c4ad678e0f tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1594 microversion: 2.1 time: 0.159335 Jul 01 19:57:01.256967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 235/476] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:01 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:01.728240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:01.728761 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:01.734882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:01.735332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.736093 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:01.736532 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:01.805601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:01.814920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:01.816454 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:01.818402 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-78f50603-1fbf-4388-9668-764bb0654946 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1336 microversion: 2.20 time: 0.094166 Jul 01 19:57:01.828882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 242/477] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:01 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1336 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:02.114484 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:02.115210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:02.121863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.122405 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.123175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.123614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.255838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:02.263985 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a21d62d1-d94b-43f6-a9d0-0fbfd4644550 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1715 microversion: 2.1 time: 0.153475 Jul 01 19:57:02.264870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 236/478] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:02 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1715 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:02.373392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:02.374034 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:02.380819 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.381601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.382384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.382868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.467157 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] HTTP exception thrown: Cannot 'detach_volume' instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 while it is in vm_state rescued Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Request method failure captured: Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments/de6728d5-707e-4911-a724-f1748cce597e HTTP/1.1 Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CVZtS93PPgLkA7SnAjCSy-8tv7JQVMczG8XKUQH2Wr5Jv0Wcj7fM1JSBoBJBcnxUeEln-ujh82P1bjr4kB48_cJvgRaQ_D5wD9eHhHG8HtyxFyXD-G3eHpNaTmoPf3iicyojiK9DRAK-qkVl3Y_QZcYzIafTzQCrxNg8FnBqxaP_M Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:57:02.468955 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 0267350339c44000bcc49906cfa8f0a6 Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:57:02.470515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Cannot 'detach_volume' instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 while it is in vm_state rescued Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'server_id': '527d64b8-42ce-4ab0-9256-f6dae97073d7', 'id': 'de6728d5-707e-4911-a724-f1748cce597e'} Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:57:02.471245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 while it is in vm_state rescued Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 while it is in vm_state rescued Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:02.472587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Returning 409 to user: Cannot 'detach_volume' instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 while it is in vm_state rescued {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:57:02.474572 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-eae836b7-dc81-493d-a521-454bc7273d05 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments/de6728d5-707e-4911-a724-f1748cce597e" status: 409 len: 152 microversion: 2.1 time: 0.101757 Jul 01 19:57:02.474572 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 243/479] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:57:02 2022] DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments/de6728d5-707e-4911-a724-f1748cce597e => generated 152 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 01 19:57:02.481993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:02.482535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:02.488696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.489143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.489935 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.490373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.561014 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-650128bb-1b8b-4d5c-adfd-b1b5c0311caa tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "POST /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/action" status: 202 len: 0 microversion: 2.1 time: 0.082687 Jul 01 19:57:02.562385 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 237/480] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:57:02 2022] POST /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:57:02.570999 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:02.571881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:02.579353 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.580312 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.581545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.582117 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.602560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:02.811573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:02.823887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-87b862c2-4f5c-49b1-bbf9-7381dc776f47 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1723 microversion: 2.1 time: 0.257244 Jul 01 19:57:02.825137 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 244/481] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:02 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:02.839402 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:02.840104 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:02.849252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.849750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:02.850524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:02.850991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:03.096878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:03.109250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:03.111165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:03.112312 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-37418538-84c5-49d0-a25d-f4f850db59a1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.279651 Jul 01 19:57:03.112877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 238/482] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:02 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:57:03.842192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:03.842820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:03.850058 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:03.850599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:03.851377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:03.851818 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:03.990959 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:03.999620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-488100b9-148d-43be-87bd-f6391a03778b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1723 microversion: 2.1 time: 0.161251 Jul 01 19:57:04.000225 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 245/483] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:03 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:04.130786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:04.132140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:04.142428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:04.143608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:04.145816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:04.146709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:04.191362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-10c4ae33-c495-4c69-981e-a30a33026973 req-8fb1967b-05c0-4d71-acb1-24c5f476cc0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:04.203720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-10c4ae33-c495-4c69-981e-a30a33026973 req-8fb1967b-05c0-4d71-acb1-24c5f476cc0b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:04.204709 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-10c4ae33-c495-4c69-981e-a30a33026973 req-8fb1967b-05c0-4d71-acb1-24c5f476cc0b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:04.218770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-10c4ae33-c495-4c69-981e-a30a33026973 req-8fb1967b-05c0-4d71-acb1-24c5f476cc0b service nova] Creating event network-changed:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:57:04.225092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-10c4ae33-c495-4c69-981e-a30a33026973 req-8fb1967b-05c0-4d71-acb1-24c5f476cc0b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037551 Jul 01 19:57:04.226612 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 246/484] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:57:04.331260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:04.360549 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:04.362862 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:04.365951 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e951c95f-669b-4ffb-b922-e7f82f4483a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.239363 Jul 01 19:57:04.367041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 239/485] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:04 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:57:05.017550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:05.019043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:05.027553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.028116 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.029218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.029925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.288300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:05.302584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-52b295c2-7833-458c-afaf-aa0707f100c1 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1723 microversion: 2.1 time: 0.288502 Jul 01 19:57:05.303512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 247/486] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:05 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1723 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:05.384588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:05.385317 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:05.393810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.394548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.395636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.396086 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.414628 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-313312034"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:05.415338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:05.422871 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.423525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.424394 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:05.424935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:05.621651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:05.629762 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:05.631382 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:05.632518 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-13f37189-518c-458e-af0b-f2f869785287 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.251966 Jul 01 19:57:05.633097 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 240/487] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:05 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:05.636377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.network.security_group_api [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Adding security group dce35b76-89c6-423c-8cb8-9feb2fe13b2a to port 8c1bb424-3191-4a82-8472-b2d89cf9baca Jul 01 19:57:06.235098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c2c95d85-0627-4f2b-b7ac-95adca4f1cd7 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/action" status: 202 len: 0 microversion: 2.1 time: 0.825215 Jul 01 19:57:06.239416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 248/488] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:57:05 2022] POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:57:06.244335 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:06.244508 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-29e68b29-54c1-4cf1-83fb-957c1b344b0d req-edb9b01c-64fd-41d6-8546-7e717caddfaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:06.246203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:06.256250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-29e68b29-54c1-4cf1-83fb-957c1b344b0d req-edb9b01c-64fd-41d6-8546-7e717caddfaa service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.259168 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-29e68b29-54c1-4cf1-83fb-957c1b344b0d req-edb9b01c-64fd-41d6-8546-7e717caddfaa service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.263871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:06.264709 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.265444 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.266717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.267391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.281994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-29e68b29-54c1-4cf1-83fb-957c1b344b0d req-edb9b01c-64fd-41d6-8546-7e717caddfaa service nova] Creating event network-changed:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:57:06.302584 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-29e68b29-54c1-4cf1-83fb-957c1b344b0d req-edb9b01c-64fd-41d6-8546-7e717caddfaa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062897 Jul 01 19:57:06.307134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 241/489] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:57:06.312431 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-d481a351-fd19-4ae1-9235-832fbe79c07e req-257a19ee-472f-4dfe-b33e-da44206e0e1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:06.328148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-d481a351-fd19-4ae1-9235-832fbe79c07e req-257a19ee-472f-4dfe-b33e-da44206e0e1e service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.328499 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-d481a351-fd19-4ae1-9235-832fbe79c07e req-257a19ee-472f-4dfe-b33e-da44206e0e1e service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.342178 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-d481a351-fd19-4ae1-9235-832fbe79c07e req-257a19ee-472f-4dfe-b33e-da44206e0e1e service nova] Creating event network-changed:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:57:06.349906 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-d481a351-fd19-4ae1-9235-832fbe79c07e req-257a19ee-472f-4dfe-b33e-da44206e0e1e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040620 Jul 01 19:57:06.351081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 242/490] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:06.358354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:06.360225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:06.371857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.372584 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.373864 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.374461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.517449 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.528794 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-740c2f85-ca07-4de4-9169-f1971556613a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1759 microversion: 2.1 time: 0.287964 Jul 01 19:57:06.529750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 249/491] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:06 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1759 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:06.558323 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.566243 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6184c6d6-52b2-4652-8155-bc3d0cb76161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1729 microversion: 2.1 time: 0.213233 Jul 01 19:57:06.568137 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 243/492] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:06 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1729 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:06.584092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:06.584510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:06.590647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.591095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.591845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.592280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.651264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:06.652046 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:06.658261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.658816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.659875 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:06.660603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:06.672050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-410eb5b5-acaf-4456-a799-a8d2c0318dbf tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092093 Jul 01 19:57:06.672655 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 250/493] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 19:57:06 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:06.933325 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.942555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.944057 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:06.945169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5a5b551b-b2fd-4c5d-84e1-5888a7fe9f06 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.298083 Jul 01 19:57:06.946102 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 244/494] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:06 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:07.963958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:07.964508 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:07.970445 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:07.970889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:07.971645 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:07.972076 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:08.279743 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:08.287908 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:08.289434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:08.290567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d65abc26-11f4-498b-a655-9ca5763315b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.331256 Jul 01 19:57:08.291213 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 251/495] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:07 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:08.367573 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-c216f9a5-81b6-4c50-ac7d-454bd09de1c5 req-c2a6f428-a25d-4144-b51f-31238544f9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d64b8-42ce-4ab0-9256-f6dae97073d7", "tag": "f3f91ef6-766f-417a-aa5e-c828666be6fa"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:08.376470 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-c216f9a5-81b6-4c50-ac7d-454bd09de1c5 req-c2a6f428-a25d-4144-b51f-31238544f9d1 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:08.376926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-c216f9a5-81b6-4c50-ac7d-454bd09de1c5 req-c2a6f428-a25d-4144-b51f-31238544f9d1 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:08.389142 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-c216f9a5-81b6-4c50-ac7d-454bd09de1c5 req-c2a6f428-a25d-4144-b51f-31238544f9d1 service nova] Creating event network-changed:f3f91ef6-766f-417a-aa5e-c828666be6fa for instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 on hv-cinder-84460 Jul 01 19:57:08.393920 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-c216f9a5-81b6-4c50-ac7d-454bd09de1c5 req-c2a6f428-a25d-4144-b51f-31238544f9d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030077 Jul 01 19:57:08.394622 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 245/496] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:57:09.308279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:09.308882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:09.310891 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:09.311511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:09.319269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:09.319709 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:09.320458 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:09.320884 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:09.456075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:09.464272 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:09.465800 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:09.466925 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-21a82010-ad1b-449a-b1f1-73137f65ecd5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.162532 Jul 01 19:57:09.467485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 252/497] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:09 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:57:10.406015 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=6 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:10.410881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-becbd0f4-c12c-492f-9f46-e7f7ca4d5c0a req-a78eb0ab-3256-40e7-8907-af1ba3340142 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "527d64b8-42ce-4ab0-9256-f6dae97073d7", "tag": "f3f91ef6-766f-417a-aa5e-c828666be6fa"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:10.419234 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-becbd0f4-c12c-492f-9f46-e7f7ca4d5c0a req-a78eb0ab-3256-40e7-8907-af1ba3340142 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:10.419669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-becbd0f4-c12c-492f-9f46-e7f7ca4d5c0a req-a78eb0ab-3256-40e7-8907-af1ba3340142 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:10.430089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-becbd0f4-c12c-492f-9f46-e7f7ca4d5c0a req-a78eb0ab-3256-40e7-8907-af1ba3340142 service nova] Creating event network-changed:f3f91ef6-766f-417a-aa5e-c828666be6fa for instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 on hv-cinder-84460 Jul 01 19:57:10.434781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-becbd0f4-c12c-492f-9f46-e7f7ca4d5c0a req-a78eb0ab-3256-40e7-8907-af1ba3340142 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029584 Jul 01 19:57:10.435343 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 246/498] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:10.484737 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:10.485348 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:10.492059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:10.492512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:10.493283 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:10.493755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:10.696309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:10.704804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:10.706334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:10.708127 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d3c17ed2-8691-4fa1-b58a-22fc63b33e70 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.227318 Jul 01 19:57:10.708683 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 253/499] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:10 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:57:11.448881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:11.450033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:11.456782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.457157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.458665 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.459131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.488129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f2f140a2-6d9c-4ab1-9791-6bdd2116ee55 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043994 Jul 01 19:57:11.488986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 247/500] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:57:11 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:57:11.533601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-a27836e9-1f43-4f1a-9bde-27a7832ef45a req-b0d53bb9-51f5-4711-8a29-05e3f975c30c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "name": "network-vif-plugged", "status": "completed", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:11.544304 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-a27836e9-1f43-4f1a-9bde-27a7832ef45a req-b0d53bb9-51f5-4711-8a29-05e3f975c30c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.544996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-a27836e9-1f43-4f1a-9bde-27a7832ef45a req-b0d53bb9-51f5-4711-8a29-05e3f975c30c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.548871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:11.549361 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:11.560312 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.560482 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-a27836e9-1f43-4f1a-9bde-27a7832ef45a req-b0d53bb9-51f5-4711-8a29-05e3f975c30c service nova] Creating event network-vif-plugged:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:57:11.560875 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.561924 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.562438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.565368 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-a27836e9-1f43-4f1a-9bde-27a7832ef45a req-b0d53bb9-51f5-4711-8a29-05e3f975c30c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035795 Jul 01 19:57:11.566345 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 254/501] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:11.594474 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:57:11.676776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e6b57fcb-50e9-4feb-9223-5283df438e7e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 204 len: 0 microversion: 2.1 time: 0.131376 Jul 01 19:57:11.678770 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 248/502] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:57:11 2022] DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:57:11.687398 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:11.688143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:11.695707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.696154 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.696919 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.697393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.727151 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:11.727762 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:11.733932 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.734384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.735146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:11.735580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:11.885811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:11.893432 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8d3c111f-d369-4936-814a-5e0d24a9e07e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1674 microversion: 2.1 time: 0.210200 Jul 01 19:57:11.894143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 255/503] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:11 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:11.912386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:11.920544 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:11.922072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:11.923173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9f2888db-c8f4-4cbf-8320-969b145d0e03 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.201083 Jul 01 19:57:11.923724 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 249/504] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:11 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:12.910882 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:12.911981 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:12.918465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:12.918908 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:12.919660 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:12.920092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:12.942333 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:12.942946 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:12.949360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:12.949842 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:12.950597 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:12.951025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:13.109438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:13.118025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4e622fa2-4ef7-4e70-8849-a45634885b37 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1674 microversion: 2.1 time: 0.210924 Jul 01 19:57:13.119004 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 256/505] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:12 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1674 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:13.125682 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:13.134282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:13.135821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:13.136903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-66fea443-3954-4e6c-817f-99dddd1aaf7e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.199059 Jul 01 19:57:13.137451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 250/506] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:12 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:14.135557 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:14.136169 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:14.142640 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:14.143091 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:14.143855 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:14.144290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:14.155460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:14.156097 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:14.163049 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:14.163491 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:14.164277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:14.164778 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:14.344778 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:14.349309 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:14.354151 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c44d4414-74e4-4fad-a157-d6aef9f81015 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1674 microversion: 2.1 time: 0.222392 Jul 01 19:57:14.354672 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 257/507] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:14 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1674 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:14.357567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:14.359115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:14.360265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e7811df4-a306-498c-966c-4f0f2b966fa7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1404 microversion: 2.20 time: 0.208619 Jul 01 19:57:14.360814 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 251/508] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:14 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:57:15.375402 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:15.376817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:15.382532 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:15.383813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:15.386382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.387025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.387796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.388386 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.389237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:15.393190 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.394036 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.395241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.396612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.546225 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:15.559330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1e464913-1b5f-4061-8a05-d3d2f0c21dba tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 200 len: 1606 microversion: 2.1 time: 0.191097 Jul 01 19:57:15.560191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 258/509] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:15 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 1606 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:15.658435 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:15.668993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:15.672138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:15.672138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0c68a242-5453-446b-8a51-e96b01f5a095 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1596 microversion: 2.20 time: 0.297312 Jul 01 19:57:15.681603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 252/510] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:57:15 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1596 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:57:15.692443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-456a4210-a4dd-4eed-85a4-cae698b93b6e req-c5384a73-7d2d-40d7-8513-e21964f25360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1a80874-00ef-4d4b-8ef0-7a604ed7458e", "name": "network-vif-deleted", "tag": "230a6a60-1da3-425e-8ff1-35512f5f96c2"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:15.693885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:15.695237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:15.701161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.702560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.703448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.703937 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-456a4210-a4dd-4eed-85a4-cae698b93b6e req-c5384a73-7d2d-40d7-8513-e21964f25360 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:15.704077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.704715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-456a4210-a4dd-4eed-85a4-cae698b93b6e req-c5384a73-7d2d-40d7-8513-e21964f25360 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:15.729023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-456a4210-a4dd-4eed-85a4-cae698b93b6e req-c5384a73-7d2d-40d7-8513-e21964f25360 service nova] Creating event network-vif-deleted:230a6a60-1da3-425e-8ff1-35512f5f96c2 for instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e on hv-cinder-84460 Jul 01 19:57:15.736171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-456a4210-a4dd-4eed-85a4-cae698b93b6e req-c5384a73-7d2d-40d7-8513-e21964f25360 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047445 Jul 01 19:57:15.736971 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 259/511] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:15.815125 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4820d158-b5b5-40f6-b37e-90dd54f19d92 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.126519 Jul 01 19:57:15.816020 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 253/512] 10.222.0.66 () {60 vars in 1315 bytes} [Fri Jul 1 19:57:15 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:57:16.581669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:16.582102 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:16.589127 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:16.589599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:16.590375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:16.590812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:16.605551 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] HTTP exception thrown: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Request method failure captured: Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e HTTP/1.1 Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CawOXuTNECAaZQHFOZy77H09Gh-584JLX96sFbun7bwW0iQcLx85NQ70iVBr3swOqs2b4yhOF36a8e_Dd26qq41bHo3xurYljxMjT8DGjhlU9Cfa4J78k9DTxNPmbDSgq23TBBXdAjfGWAAIp3ohSyA932NFi-lIIuWa6pTVdj5ow Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:57:16.607244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3198a63f6d1a4cdd88d76189658e79c0 Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:57:16.608905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'c1a80874-00ef-4d4b-8ef0-7a604ed7458e'} Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:57:16.609717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:57:16.610917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:57:16.611993 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Returning 404 to user: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:57:16.611993 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-893acfb6-6bcd-4b29-bf81-754f9bca6a71 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 404 len: 111 microversion: 2.1 time: 0.032836 Jul 01 19:57:16.611993 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 260/513] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:16 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:57:16.618663 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4cfbb0c4-3322-4142-9a1d-2c1bba3ec01e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '.version_select at 0x7fa0074bd820>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:16.637360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4cfbb0c4-3322-4142-9a1d-2c1bba3ec01e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715139908" status: 202 len: 0 microversion: 2.1 time: 0.023708 Jul 01 19:57:16.638028 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 254/514] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 1 19:57:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715139908 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:57:17.285814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ea9439e2-dbf4-4549-8e35-4053d8f4cc69 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: .version_select at 0x7fa0075e8ca0>, body: {"keypair": {"name": "tempest-keypair-99438602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ftn+YKjh1B4L7puYLv9IJ8izO4SYfxand3bIoW8ICfIbbFlm+PsadMzliBxX8+FmDhckGJBZHm3KQDZy63yR6ABb014SP2kc+Pkbu6PPm7mXQ7Z5/VDdM+FakZO/k1w=="}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:17.300425 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-ea9439e2-dbf4-4549-8e35-4053d8f4cc69 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for project 025035b3b0b348d7acddfe456dd6a109. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:57:17.304874 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-ea9439e2-dbf4-4549-8e35-4053d8f4cc69 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for user 3198a63f6d1a4cdd88d76189658e79c0 and project 025035b3b0b348d7acddfe456dd6a109. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:57:17.326739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ea9439e2-dbf4-4549-8e35-4053d8f4cc69 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044782 Jul 01 19:57:17.327337 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 261/515] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:57:17 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:57:17.754684 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-a4f436a3-2b60-4395-8dc4-4218323ec7c5 req-b27dbf31-8058-4b73-a8ba-89aa8547d0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:17.765353 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-a4f436a3-2b60-4395-8dc4-4218323ec7c5 req-b27dbf31-8058-4b73-a8ba-89aa8547d0c8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:17.765825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-a4f436a3-2b60-4395-8dc4-4218323ec7c5 req-b27dbf31-8058-4b73-a8ba-89aa8547d0c8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:17.776994 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-a4f436a3-2b60-4395-8dc4-4218323ec7c5 req-b27dbf31-8058-4b73-a8ba-89aa8547d0c8 service nova] Creating event network-changed:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:57:17.782728 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-a4f436a3-2b60-4395-8dc4-4218323ec7c5 req-b27dbf31-8058-4b73-a8ba-89aa8547d0c8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034634 Jul 01 19:57:17.783384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 255/516] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:18.682757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1769628104", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b31a2a85-453d-4d0b-bc1f-fd678ffc85ef"}], "security_groups": [{"name": "tempest-securitygroup--142335435"}], "key_name": "tempest-keypair-99438602", "user_data": "}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:18.784694 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] validate_networks() for [('b31a2a85-453d-4d0b-bc1f-fd678ffc85ef', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:57:19.154696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:57:19.155122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:57:19.155601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:57:19.156014 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:57:19.156428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:57:19.166382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:19.166830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:19.167627 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:19.168063 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:19.184840 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for project 025035b3b0b348d7acddfe456dd6a109. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:57:19.188753 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Getting quotas for user 3198a63f6d1a4cdd88d76189658e79c0 and project 025035b3b0b348d7acddfe456dd6a109. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:57:19.199558 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:57:19.201801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:57:19.246689 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ca762229-9175-4c5e-a5e7-cc14f2a2fa65 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.569121 Jul 01 19:57:19.247328 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 262/517] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:57:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:57:19.258438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-60a41cd8-137f-4ecc-ac67-5889a0257dfd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:19.259226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-60a41cd8-137f-4ecc-ac67-5889a0257dfd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:19.321059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-60a41cd8-137f-4ecc-ac67-5889a0257dfd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:19.327710 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-60a41cd8-137f-4ecc-ac67-5889a0257dfd tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1236 microversion: 2.1 time: 0.074036 Jul 01 19:57:19.328275 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 256/518] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:19 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1236 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:19.803451 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:19.804035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:19.811192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:19.811671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:19.812500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:19.813003 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:19.839096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lazy-loading 'flavor' on Instance uuid ee927ae4-fe7f-411f-be38-1d732b6ba6e3 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:57:19.913491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-10fe9c33-905b-44a8-a0bf-819c59962f93 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "POST /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3/action" status: 202 len: 0 microversion: 2.1 time: 0.114581 Jul 01 19:57:19.914106 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 263/519] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:57:19 2022] POST /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:57:19.922243 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:19.922844 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:19.930670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:19.931107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:19.931877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:19.932301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:20.077682 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:20.085908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e803e8cc-00d5-44f4-b83d-f0f4b7cdbc39 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.167412 Jul 01 19:57:20.086473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 257/520] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:19 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:20.348589 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:20.349875 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:20.357495 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:20.358141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:20.358915 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:20.359491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:20.364644 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:20.694067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:20.701559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3464d806-48cc-43f2-ba8c-30c54835e066 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1296 microversion: 2.1 time: 0.359152 Jul 01 19:57:20.702165 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 264/521] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:20 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1296 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:21.103726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:21.104346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:21.111577 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:21.112161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:21.113182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:21.113531 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:21.293636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:21.302145 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-45f00c44-a153-4901-917b-eae373baf28d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.202270 Jul 01 19:57:21.302707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 258/522] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:21 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:21.719285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:21.720011 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:21.727178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:21.727631 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:21.728400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:21.728838 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:21.940212 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:21.949171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c1c364ea-0128-49f9-bef1-4e23c02f9277 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.233629 Jul 01 19:57:21.949980 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 265/523] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:21 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:22.163372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-7540a16e-7c87-4f97-af10-215fcdf8a426 req-5bb03cd2-011e-4d5d-b751-6be105372cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81be27a4-51b0-4fa6-8e9b-003575784817", "tag": "60d81827-fc49-4b52-8bdd-57665e59e05d"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:22.175518 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-7540a16e-7c87-4f97-af10-215fcdf8a426 req-5bb03cd2-011e-4d5d-b751-6be105372cda service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:22.176872 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-7540a16e-7c87-4f97-af10-215fcdf8a426 req-5bb03cd2-011e-4d5d-b751-6be105372cda service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:22.191691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-7540a16e-7c87-4f97-af10-215fcdf8a426 req-5bb03cd2-011e-4d5d-b751-6be105372cda service nova] Creating event network-changed:60d81827-fc49-4b52-8bdd-57665e59e05d for instance 81be27a4-51b0-4fa6-8e9b-003575784817 on hv-cinder-84460 Jul 01 19:57:22.198497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-7540a16e-7c87-4f97-af10-215fcdf8a426 req-5bb03cd2-011e-4d5d-b751-6be105372cda service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041189 Jul 01 19:57:22.199191 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 259/524] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:22.320179 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:22.320785 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:22.327513 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:22.328046 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:22.328871 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:22.329367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:22.560462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:22.568425 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8adf92cf-e174-46ea-aad8-67e68730be29 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.253322 Jul 01 19:57:22.569004 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 266/525] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:22 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:22.967367 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:22.968072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:22.975208 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:22.975656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:22.976419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:22.976856 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:23.116736 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:23.124595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9112b54e-b0f9-48cd-a1f8-6439fa749644 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.161155 Jul 01 19:57:23.125163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 260/526] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:22 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:23.585484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:23.586157 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:23.588533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:23.593834 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:23.594292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:23.595056 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:23.595497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:23.727461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:23.734941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3180f640-df27-4c34-b019-862960c49e68 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.153528 Jul 01 19:57:23.735561 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 267/527] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:23 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:24.141952 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:24.142516 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:24.149540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:24.150021 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:24.150786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:24.151221 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:24.321284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:24.328677 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-51191fdd-e68b-4e2a-baf2-cb7c1b560b06 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.190774 Jul 01 19:57:24.329243 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 261/528] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:24 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:24.752361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:24.752967 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:24.760434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:24.760883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:24.761681 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:24.762120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:24.898650 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:24.906237 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-67c2ca87-e719-4aa5-8909-28b4c07d6b14 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.157888 Jul 01 19:57:24.906802 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 268/529] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:24 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:25.346235 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:25.346850 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:25.353836 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:25.354288 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:25.355053 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:25.355496 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:25.375134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:25.492084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:25.499575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5c347903-170b-454d-a52d-897ba0243884 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.157207 Jul 01 19:57:25.509561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 262/530] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:25 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:25.923071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:25.923808 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:25.930832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:25.931277 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:25.932035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:25.932468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:26.069941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:26.077655 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-faa8abc7-a570-4c6d-8f4a-7fe3d9ad04b0 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.158402 Jul 01 19:57:26.078227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 269/531] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:25 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:26.517305 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:26.517933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:26.525203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:26.525676 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:26.526423 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:26.526847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:26.654381 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:26.662277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6fc40d64-fb1f-40e2-956d-145eec039fb7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.148928 Jul 01 19:57:26.662847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 263/532] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:26 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:27.095551 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:27.096167 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:27.102998 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:27.103448 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:27.104207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:27.104644 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:27.236699 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:27.244988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-af7c0d9e-3b9f-4147-99ea-29649c88ddb7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.153332 Jul 01 19:57:27.245538 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 270/533] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:27 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:27.545270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-ef263946-d35a-4960-bbb9-2fe926ee81b9 req-21b66f0b-c21a-4735-865a-5d43f0ff544e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81be27a4-51b0-4fa6-8e9b-003575784817", "name": "network-vif-plugged", "status": "completed", "tag": "60d81827-fc49-4b52-8bdd-57665e59e05d"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:27.555158 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-ef263946-d35a-4960-bbb9-2fe926ee81b9 req-21b66f0b-c21a-4735-865a-5d43f0ff544e service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:27.555603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-ef263946-d35a-4960-bbb9-2fe926ee81b9 req-21b66f0b-c21a-4735-865a-5d43f0ff544e service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:27.568575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-ef263946-d35a-4960-bbb9-2fe926ee81b9 req-21b66f0b-c21a-4735-865a-5d43f0ff544e service nova] Creating event network-vif-plugged:60d81827-fc49-4b52-8bdd-57665e59e05d for instance 81be27a4-51b0-4fa6-8e9b-003575784817 on hv-cinder-84460 Jul 01 19:57:27.573706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-ef263946-d35a-4960-bbb9-2fe926ee81b9 req-21b66f0b-c21a-4735-865a-5d43f0ff544e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031911 Jul 01 19:57:27.574315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 264/534] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:27.680369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:27.680980 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:27.687221 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:27.687657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:27.688534 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:27.688966 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:27.871543 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:27.878867 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b134cb00-1c65-42d4-903e-3f5152c1b5d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.203654 Jul 01 19:57:27.879508 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 271/535] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:27 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:28.263789 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:28.264488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:28.272371 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:28.273157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:28.274391 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:28.274859 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:28.426656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:28.434368 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5d52f137-6d33-4f4c-bfef-5ee5276fa4ec tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.174860 Jul 01 19:57:28.434949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 265/536] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:28 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:28.895792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:28.896400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:28.903177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:28.903622 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:28.904379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:28.904815 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.036443 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:29.044433 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ab997e1f-1fd2-4d68-88c6-5c5f03b03f0c tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1361 microversion: 2.1 time: 0.152640 Jul 01 19:57:29.045021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 272/537] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:28 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:29.357525 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:29.358517 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:29.360897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:29.367285 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:29.367741 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.368496 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:29.368932 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.444395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b8cf0dcd-9592-4076-923a-f294e35afc5d tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/action" status: 202 len: 0 microversion: 2.1 time: 0.090615 Jul 01 19:57:29.445063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 266/538] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:57:29 2022] POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:57:29.452387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:29.453000 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:29.453223 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:29.453984 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:29.458863 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:29.459645 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=10 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:29.460975 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:29.461460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.462081 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:29.462400 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:29.462597 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.462871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.463516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:29.463961 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:29.667186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:29.674745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1b7de50b-677a-4c55-ad6b-89db12c2365b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.226344 Jul 01 19:57:29.675362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 273/539] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:29 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:29.684563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:29.692655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6da38869-9d09-4cf7-b4e2-3255baa248fe tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1751 microversion: 2.1 time: 0.243414 Jul 01 19:57:29.693208 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 267/540] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:29 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1751 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:30.061651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:30.062266 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:30.069433 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.069920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.071302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.071758 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.201350 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:30.209369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9b3c89a8-dd86-4ee1-8aac-934028a62c3b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1548 microversion: 2.1 time: 0.151524 Jul 01 19:57:30.209971 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 274/541] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:30 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:30.225857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:30.226349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:30.232513 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.232956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.233740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.234171 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.320229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bebf887f-c406-4b42-ad4d-3e0266cda635 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098800 Jul 01 19:57:30.321330 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 268/542] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 19:57:30 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:30.692189 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:30.692816 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:30.698952 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.699403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.700167 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.700601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.711792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:30.713093 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:30.726369 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.727215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:30.728129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:30.728668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:31.350523 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:31.358786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9ebb800c-7127-4390-a478-54fca40fd6a7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.670542 Jul 01 19:57:31.360453 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:31.360611 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 275/543] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:30 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:31.368580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-400b3c34-03e0-4614-908c-45fad6d273c5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1751 microversion: 2.1 time: 0.661513 Jul 01 19:57:31.369203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 269/544] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:30 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1751 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:31.803421 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-dd1b85f0-2841-4c4e-b923-d29ef7b6e122 req-67f1cc0d-09d8-47c3-b0c4-f141ae57c200 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81be27a4-51b0-4fa6-8e9b-003575784817", "tag": "60d81827-fc49-4b52-8bdd-57665e59e05d"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:31.811669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-dd1b85f0-2841-4c4e-b923-d29ef7b6e122 req-67f1cc0d-09d8-47c3-b0c4-f141ae57c200 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:31.812119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-dd1b85f0-2841-4c4e-b923-d29ef7b6e122 req-67f1cc0d-09d8-47c3-b0c4-f141ae57c200 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:31.824153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-dd1b85f0-2841-4c4e-b923-d29ef7b6e122 req-67f1cc0d-09d8-47c3-b0c4-f141ae57c200 service nova] Creating event network-changed:60d81827-fc49-4b52-8bdd-57665e59e05d for instance 81be27a4-51b0-4fa6-8e9b-003575784817 on hv-cinder-84460 Jul 01 19:57:31.829244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-dd1b85f0-2841-4c4e-b923-d29ef7b6e122 req-67f1cc0d-09d8-47c3-b0c4-f141ae57c200 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030087 Jul 01 19:57:31.830051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 276/545] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:32.376209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:32.376747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:32.384277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:32.384716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:32.385514 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:32.386172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:32.387525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:32.388229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:32.396438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:32.396998 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:32.398214 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:32.398655 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:32.597519 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:32.606592 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c2028c27-a24e-4b71-8cbf-5ccca5be35bf tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.234400 Jul 01 19:57:32.607617 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 270/546] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:32 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:32.622295 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:32.631268 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b13157c4-30a7-42b6-9085-950137e47975 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1751 microversion: 2.1 time: 0.248872 Jul 01 19:57:32.631767 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 277/547] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:32 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1751 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:33.623400 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:33.624040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:33.631016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:33.631745 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:33.632519 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:33.632945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:33.648909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:33.650489 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:33.657463 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:33.657940 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:33.658748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:33.659163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:33.862900 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:33.871228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-68b19bc9-d9a4-48ac-84d1-3692930b097e tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.251729 Jul 01 19:57:33.871805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 271/548] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:33 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:33.881233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:33.889171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-462298be-5f59-4150-9e29-80e28c865ab3 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.244684 Jul 01 19:57:33.889753 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 278/549] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:33 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:34.888073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:34.888670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:34.895714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:34.896150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:34.896905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:34.897335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:34.906887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:34.907661 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:34.914334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:34.914798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:34.915544 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:34.915979 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:35.103593 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:35.111160 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bdc7877e-aadb-4b04-8882-61ea26179bb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1510 microversion: 2.1 time: 0.226941 Jul 01 19:57:35.111726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 272/550] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:34 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:35.123247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:35.127706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:35.128269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:35.131911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7a8603ea-5c5d-44c7-a3be-f2574196ba3b tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.228822 Jul 01 19:57:35.132478 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 279/551] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:34 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:35.134561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:35.135003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:35.135759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:35.136187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:35.212825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a37f9768-5a5f-4ec7-ba64-54ded3907298 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "POST /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3/action" status: 202 len: 0 microversion: 2.1 time: 0.088842 Jul 01 19:57:35.213782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 273/552] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:57:35 2022] POST /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:57:35.222090 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:35.223345 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:35.229360 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:35.229852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:35.230737 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:35.231177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:35.420110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:35.428551 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c2e4e7bf-79ad-4f56-9b71-bbee742b4fc2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1518 microversion: 2.1 time: 0.210535 Jul 01 19:57:35.429125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 280/553] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:35 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:35.558336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-8a5a8d4b-bb7d-45ad-ba92-44486968dbc2 req-5d8d31d8-0252-4ac3-8582-e5bd45038aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "name": "network-vif-unplugged", "status": "completed", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:35.567629 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-8a5a8d4b-bb7d-45ad-ba92-44486968dbc2 req-5d8d31d8-0252-4ac3-8582-e5bd45038aa0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:35.568302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-8a5a8d4b-bb7d-45ad-ba92-44486968dbc2 req-5d8d31d8-0252-4ac3-8582-e5bd45038aa0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:35.580179 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.compute.server_external_events [req-8a5a8d4b-bb7d-45ad-ba92-44486968dbc2 req-5d8d31d8-0252-4ac3-8582-e5bd45038aa0 service nova] Unable to find a host for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3. Dropping event network-vif-unplugged {{(pid=124286) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 01 19:57:35.581058 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-8a5a8d4b-bb7d-45ad-ba92-44486968dbc2 req-5d8d31d8-0252-4ac3-8582-e5bd45038aa0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029022 Jul 01 19:57:35.581664 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 274/554] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 01 19:57:36.155399 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:36.156019 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:36.163125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:36.163574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:36.164335 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:36.164778 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:36.184362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=100 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:36.320696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:36.328619 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5872d7b0-228e-49c5-9543-b9dce625efcf tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.177071 Jul 01 19:57:36.329187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 281/555] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:36 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:36.445146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:36.445811 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:36.452227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:36.452672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:36.453420 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:36.453882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:36.606010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:36.614820 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fd5cfbe2-cde8-47d2-af62-4b5ca6d3523c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1520 microversion: 2.1 time: 0.172640 Jul 01 19:57:36.615392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 275/556] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:36 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:37.346413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:37.347040 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:37.355024 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:37.355471 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:37.356227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:37.356659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:37.607052 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:37.615403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6a18d12c-4120-4ec8-b3fd-ebb091bcf6bd tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.272830 Jul 01 19:57:37.615975 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 282/557] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:37 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:37.632505 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:37.633138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:37.639585 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:37.640025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:37.640789 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:37.641227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:37.857867 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:37.866055 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4c8b1db7-1b39-4176-9a23-07a809f3a518 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.237865 Jul 01 19:57:37.866630 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 276/558] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:37 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:38.632496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:38.633133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:38.639710 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:38.640301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:38.641064 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:38.641504 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:38.788023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:38.795825 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c20209b5-234d-4755-874b-b78ccf1251f5 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.167436 Jul 01 19:57:38.796391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 283/559] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:38 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:38.882752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:38.883366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:38.889543 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:38.890027 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:38.890784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:38.891228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:39.020780 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:39.028564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-27fbd058-fef6-4306-9b59-02ac770e6618 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.149853 Jul 01 19:57:39.029128 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 277/560] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:38 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:39.812783 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:39.813394 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:39.820502 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:39.820945 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:39.821757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:39.822212 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:39.968459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:39.976564 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-45e794e4-fb80-4fac-8e75-45a01d477ab1 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.167668 Jul 01 19:57:39.977126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 284/561] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:39 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:40.045222 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:40.045872 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:40.053595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:40.054037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:40.054787 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:40.055212 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:40.184877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:40.188434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:40.194660 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e708fad4-ebe4-4104-8df6-c1a3f924147d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.153164 Jul 01 19:57:40.195229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 278/562] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:40 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:40.994587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:40.995257 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:41.001767 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:41.002215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:41.002976 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:41.003417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:41.151545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:41.159516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-452e9eba-ea95-4fc4-8074-8ba692ba1601 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.168865 Jul 01 19:57:41.160794 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 285/563] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:40 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:41.211414 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:41.211943 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:41.219124 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:41.219576 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:41.220371 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:41.220816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:41.351284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:41.358873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-051e64eb-d1b8-45ab-a216-cc7b81c58f1d tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.151799 Jul 01 19:57:41.359442 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 279/564] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:41 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:42.178467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:42.179001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:42.185745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:42.186231 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:42.187004 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:42.187442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:42.334044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:42.341913 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5f657429-7ce0-4a18-a572-726c8f4b1f01 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.168301 Jul 01 19:57:42.342507 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 286/565] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:42 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:42.376482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:42.377227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:42.384839 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:42.385277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:42.386052 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:42.386481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:42.569868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:42.577255 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-0d4dcf91-2102-4451-ab09-da9d5d53cc4c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.204732 Jul 01 19:57:42.577847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 280/566] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:42 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:43.359463 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:43.360205 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:43.366640 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:43.367086 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:43.367839 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:43.368275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:43.559316 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:43.568061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1091b274-46f8-43c2-bec4-f723c171124a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1756 microversion: 2.1 time: 0.212401 Jul 01 19:57:43.568625 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 287/567] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:43 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:43.593996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:43.594607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:43.601043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:43.601488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:43.602280 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:43.602715 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:43.743713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:43.751199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4a837961-4619-4d60-b7d1-86443b83eca9 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.160985 Jul 01 19:57:43.751758 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 281/568] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:43 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:44.585354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:44.586002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:44.592605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:44.593053 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:44.593845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:44.594285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:44.735126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:44.743973 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e3b4b21c-29cf-4971-8f46-dc18affe6c1a tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1759 microversion: 2.1 time: 0.162575 Jul 01 19:57:44.744547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 288/569] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:44 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1759 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:44.767968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:44.768578 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:44.775415 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:44.775864 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:44.776618 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:44.777105 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:44.913865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:44.921463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cc133156-16f6-4e3c-8264-89d973c28bfa tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.157278 Jul 01 19:57:44.922055 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 282/570] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:44 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:45.939059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:45.939697 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:45.946868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:45.947307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:45.948062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:45.948496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:46.078722 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:46.086504 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4cf57ed5-e201-41b0-92c0-d835a2013eb2 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.151295 Jul 01 19:57:46.087067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 289/571] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:45 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:47.103811 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:47.104473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:47.106779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:47.112778 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:47.113227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:47.114183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:47.114475 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:47.248204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:47.256192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2ebbf7ae-d638-4295-8dd1-3733e54e4716 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.156208 Jul 01 19:57:47.257157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 283/572] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:47 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:48.274272 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:48.274940 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:48.281378 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:48.281848 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:48.282598 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:48.283024 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:48.417143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:48.424657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d9574608-c221-432b-a251-f81e4a714dc7 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.156325 Jul 01 19:57:48.425216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 290/573] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:48 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:49.116278 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:49.116771 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:49.123308 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.123757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.124648 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.124978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.206809 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lazy-loading 'services' on Instance uuid 527d64b8-42ce-4ab0-9256-f6dae97073d7 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:57:49.285189 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cf52fd87-bc77-44ed-b60d-2bea2ff700fb tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments/de6728d5-707e-4911-a724-f1748cce597e" status: 202 len: 0 microversion: 2.1 time: 0.173220 Jul 01 19:57:49.286892 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 284/574] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:57:49 2022] DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments/de6728d5-707e-4911-a724-f1748cce597e => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:57:49.294693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:49.295703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:49.302697 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.303232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.304022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.304482 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.334919 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-eddab855-895d-4032-bb90-25eae00329f0 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044089 Jul 01 19:57:49.335497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 291/575] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:57:49 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:49.442494 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:49.443194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:49.449458 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.449942 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.450701 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.451140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.587929 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:49.595672 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9357d0a6-82bc-42e4-baf4-62e5b04f62f1 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.157555 Jul 01 19:57:49.596430 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 285/576] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:49 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:49.654770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-9ddb9d7a-80a5-47c7-a0d9-b9d4586dc666 req-83900f21-8cbb-4596-b214-0d15a3f0dab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "name": "network-vif-plugged", "status": "completed", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:49.663992 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9ddb9d7a-80a5-47c7-a0d9-b9d4586dc666 req-83900f21-8cbb-4596-b214-0d15a3f0dab9 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:49.664555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9ddb9d7a-80a5-47c7-a0d9-b9d4586dc666 req-83900f21-8cbb-4596-b214-0d15a3f0dab9 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:49.676740 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-9ddb9d7a-80a5-47c7-a0d9-b9d4586dc666 req-83900f21-8cbb-4596-b214-0d15a3f0dab9 service nova] Creating event network-vif-plugged:1703035c-ecba-43aa-ab94-ee8dc5dedbe4 for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 on hv-cinder-84460 Jul 01 19:57:49.681869 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-9ddb9d7a-80a5-47c7-a0d9-b9d4586dc666 req-83900f21-8cbb-4596-b214-0d15a3f0dab9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030786 Jul 01 19:57:49.682468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 292/577] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:50.347445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:50.349056 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:50.355703 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.356157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.356925 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.357356 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.388484 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-413f9753-d0fa-4162-b61e-d110046a32c7 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045790 Jul 01 19:57:50.389058 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 286/578] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:57:50 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:57:50.463331 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:50.463918 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:50.470245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.470700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.471539 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.471947 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.496747 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:57:50.571516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-39525571-e088-4809-a691-60fb7477d681 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 204 len: 0 microversion: 2.1 time: 0.112709 Jul 01 19:57:50.572080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 293/579] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:57:50 2022] DELETE /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:57:50.580139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:50.580802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:50.586872 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.587313 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.588070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.588498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.613207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:50.614649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:50.621012 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.621464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.622271 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:50.622711 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:50.799686 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:50.808024 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-57856c48-5653-407e-92d6-5dc9e78cf1e5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1689 microversion: 2.1 time: 0.231748 Jul 01 19:57:50.808598 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 287/580] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:50 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1689 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:50.809440 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:50.816550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-43ffe5e2-6dcf-43ec-b472-1e93e2fc3d1b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.207951 Jul 01 19:57:50.817109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 294/581] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:50 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:51.825947 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:51.826546 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:51.833834 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:51.834281 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:51.834424 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:51.834525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:51.835056 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:51.835487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:51.841168 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:51.841639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:51.842403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:51.842830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:52.026203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:52.034000 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6d01f730-2c00-4643-9c6c-b8bb8c768f79 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1689 microversion: 2.1 time: 0.211764 Jul 01 19:57:52.034590 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 288/582] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:51 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:52.036451 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:52.044802 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6ed7e7ce-e665-4f5f-9e30-54d12e6f7e10 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.215469 Jul 01 19:57:52.045372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 295/583] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:51 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:53.051555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:53.052161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:53.058781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:53.059236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:53.059979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:53.060413 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:53.061728 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:53.062362 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:53.069562 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:53.070043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:53.070801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:53.071239 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:53.262805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:53.267211 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:53.271161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-023871ff-ebd2-43b4-a55e-c4b07b69089c tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1689 microversion: 2.1 time: 0.223422 Jul 01 19:57:53.271915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 289/584] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:53 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1689 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:53.276014 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-88482925-7a52-4012-a7df-efa19f42031b tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.218034 Jul 01 19:57:53.276577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 296/585] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:53 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:54.294166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:54.294778 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:54.297191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:54.312047 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:54.312047 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:54.312047 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:54.312047 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:54.312657 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:57:54.353723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:54.354454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:54.360515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:54.361027 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:54.362073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:54.362613 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:54.496872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:54.509542 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-99353c4d-b2c2-42bd-a948-35436a538c0f tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1576 microversion: 2.1 time: 0.220818 Jul 01 19:57:54.510158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 297/586] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:54 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:54.524810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:54.532242 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bf3665b3-130b-4618-8dc5-c0de4f458e08 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1689 microversion: 2.1 time: 0.247277 Jul 01 19:57:54.532800 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 290/587] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:54 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:55.527175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:55.527786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:55.534744 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:55.535771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:55.536540 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:55.537152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:55.549020 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:55.549662 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:55.561062 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:55.561536 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:55.567543 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:55.567993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:55.862017 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:55.871003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-25617495-8888-4b9b-8346-91df25eb80c9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1689 microversion: 2.1 time: 0.325698 Jul 01 19:57:55.871194 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:55.871581 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 291/588] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:55 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1689 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:57:55.883510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a553295e-55d7-4a8f-94f6-4715d4680490 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1563 microversion: 2.1 time: 0.359891 Jul 01 19:57:55.884499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 298/589] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:55 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1563 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:56.392462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-69629f40-0c66-40e1-b16d-bcc84498941b req-8e17fc4e-bdf0-4aea-8fe3-36b7f41769cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "527d64b8-42ce-4ab0-9256-f6dae97073d7", "name": "network-vif-deleted", "tag": "f3f91ef6-766f-417a-aa5e-c828666be6fa"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:57:56.402625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-69629f40-0c66-40e1-b16d-bcc84498941b req-8e17fc4e-bdf0-4aea-8fe3-36b7f41769cd service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:56.403345 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-69629f40-0c66-40e1-b16d-bcc84498941b req-8e17fc4e-bdf0-4aea-8fe3-36b7f41769cd service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:56.415603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-69629f40-0c66-40e1-b16d-bcc84498941b req-8e17fc4e-bdf0-4aea-8fe3-36b7f41769cd service nova] Creating event network-vif-deleted:f3f91ef6-766f-417a-aa5e-c828666be6fa for instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 on hv-cinder-84460 Jul 01 19:57:56.420952 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-69629f40-0c66-40e1-b16d-bcc84498941b req-8e17fc4e-bdf0-4aea-8fe3-36b7f41769cd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032075 Jul 01 19:57:56.421815 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 292/590] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:57:56.889398 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:56.890063 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:56.897329 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:56.897818 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:56.898604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:56.899042 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:56.934207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:56.934822 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:56.935264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lazy-loading 'fault' on Instance uuid 527d64b8-42ce-4ab0-9256-f6dae97073d7 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:57:56.983936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:57:56.991998 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6c4f0d19-21a5-468f-b9f5-870a15c17161 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 200 len: 1335 microversion: 2.1 time: 0.106653 Jul 01 19:57:56.992580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 299/591] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:56 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 1335 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:57:58.009330 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:58.010050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: 527d64b8-42ce-4ab0-9256-f6dae97073d7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:57:58.016275 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:58.016721 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:58.017479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:57:58.017945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:57:58.031876 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] HTTP exception thrown: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 could not be found. Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Request method failure captured: Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 HTTP/1.1 Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CVZtS93PPgLkA7SnAjCSy-8tv7JQVMczG8XKUQH2Wr5Jv0Wcj7fM1JSBoBJBcnxUeEln-ujh82P1bjr4kB48_cJvgRaQ_D5wD9eHhHG8HtyxFyXD-G3eHpNaTmoPf3iicyojiK9DRAK-qkVl3Y_QZcYzIafTzQCrxNg8FnBqxaP_M Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:57:58.033467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 0267350339c44000bcc49906cfa8f0a6 Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 could not be found. Jul 01 19:57:58.035668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '527d64b8-42ce-4ab0-9256-f6dae97073d7'} Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 could not be found. Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:57:58.036655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 could not be found. Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 could not be found. Jul 01 19:57:58.038163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:57:58.039461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Returning 404 to user: Instance 527d64b8-42ce-4ab0-9256-f6dae97073d7 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:57:58.039461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-335ead32-e2d0-4ada-add0-9804bb032259 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7" status: 404 len: 111 microversion: 2.1 time: 0.030379 Jul 01 19:57:58.039461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 293/592] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:57:58 2022] GET /compute/v2.1/servers/527d64b8-42ce-4ab0-9256-f6dae97073d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:57:58.044206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d6c4512b-8bed-4b6b-ac9c-165df564dac5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '.version_select at 0x7fa00770f040>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:57:58.062243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d6c4512b-8bed-4b6b-ac9c-165df564dac5 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041592530" status: 202 len: 0 microversion: 2.1 time: 0.021772 Jul 01 19:57:58.062793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 300/593] 10.222.0.66 () {58 vars in 1220 bytes} [Fri Jul 1 19:57:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1041592530 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:58:01.153863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:01.154355 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:01.161542 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:01.162019 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:01.162795 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:01.163241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:01.187673 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:58:01.231749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:01.265079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1dcfcb22-5483-40cd-b8d7-eeaed37bd25d tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 204 len: 0 microversion: 2.1 time: 0.114500 Jul 01 19:58:01.265696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 294/594] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:58:01 2022] DELETE /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:58:01.276009 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:01.276631 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:01.282651 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:01.283106 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:01.283869 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:01.284306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:01.414707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:01.422343 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ae0a87d0-12fd-4be0-8dbb-b6fb874362a3 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1507 microversion: 2.1 time: 0.151499 Jul 01 19:58:01.422913 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 301/595] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:01 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:02.439277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:02.439972 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:02.446634 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:02.447106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:02.447862 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:02.448292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:02.582433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:02.589867 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-12faf6e5-6bde-4e7e-9d92-c8ac1368b5dc tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1507 microversion: 2.1 time: 0.154777 Jul 01 19:58:02.590437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 295/596] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:02 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:03.605911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:03.606422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:03.606922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:03.607606 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:03.612537 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:03.613023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:03.613905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:03.614341 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:03.614871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:03.615324 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:03.616086 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:03.616526 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:03.637456 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-78289f7e-a8f2-4aa1-b0eb-87b857e4d52a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/ips" status: 200 len: 151 microversion: 2.20 time: 0.090461 Jul 01 19:58:03.638052 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 302/597] 10.222.0.66 () {60 vars in 1288 bytes} [Fri Jul 1 19:58:03 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 01 19:58:03.751150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:03.759391 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d5eb5566-8bb6-493a-bc88-86c81bcb9b6f tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1507 microversion: 2.1 time: 0.156364 Jul 01 19:58:03.759968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 296/598] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:03 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:04.368635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-00c99e5e-84dc-4cc1-b151-17e1a99e2722 req-b9c5d943-032b-4593-b869-1db279b7c6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68aa76c-bae5-43da-9f08-50f825938444", "name": "network-vif-deleted", "tag": "644f4558-dca6-454f-9465-da30f533731d"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:04.377620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-00c99e5e-84dc-4cc1-b151-17e1a99e2722 req-b9c5d943-032b-4593-b869-1db279b7c6ee service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:04.379638 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-00c99e5e-84dc-4cc1-b151-17e1a99e2722 req-b9c5d943-032b-4593-b869-1db279b7c6ee service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:04.391604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-00c99e5e-84dc-4cc1-b151-17e1a99e2722 req-b9c5d943-032b-4593-b869-1db279b7c6ee service nova] Creating event network-vif-deleted:644f4558-dca6-454f-9465-da30f533731d for instance a68aa76c-bae5-43da-9f08-50f825938444 on hv-cinder-84460 Jul 01 19:58:04.399331 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-00c99e5e-84dc-4cc1-b151-17e1a99e2722 req-b9c5d943-032b-4593-b869-1db279b7c6ee service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034366 Jul 01 19:58:04.400032 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 303/599] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:04.777118 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:04.777795 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:04.784397 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:04.784841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:04.785614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:04.786616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:04.822193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:04.822936 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:04.823783 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lazy-loading 'fault' on Instance uuid a68aa76c-bae5-43da-9f08-50f825938444 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:04.875886 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:04.884349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1ce1f1c8-d5e8-4674-91a8-527b17f142a6 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 200 len: 1311 microversion: 2.1 time: 0.111030 Jul 01 19:58:04.885112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 297/600] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:04 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:05.839364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:05.839987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:05.846734 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:05.847183 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:05.847941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:05.848928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:05.871780 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lazy-loading 'flavor' on Instance uuid aebdcfdb-f355-4d88-94a2-ef1d4191f28d {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:05.901472 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:05.902115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: a68aa76c-bae5-43da-9f08-50f825938444] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:05.908279 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:05.908754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:05.909510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:05.909966 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:05.926240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] HTTP exception thrown: Instance a68aa76c-bae5-43da-9f08-50f825938444 could not be found. Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Request method failure captured: Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 HTTP/1.1 Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CVZtS93PPgLkA7SnAjCSy-8tv7JQVMczG8XKUQH2Wr5Jv0Wcj7fM1JSBoBJBcnxUeEln-ujh82P1bjr4kB48_cJvgRaQ_D5wD9eHhHG8HtyxFyXD-G3eHpNaTmoPf3iicyojiK9DRAK-qkVl3Y_QZcYzIafTzQCrxNg8FnBqxaP_M Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:58:05.928567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 0267350339c44000bcc49906cfa8f0a6 Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance a68aa76c-bae5-43da-9f08-50f825938444 could not be found. Jul 01 19:58:05.930063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'a68aa76c-bae5-43da-9f08-50f825938444'} Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68aa76c-bae5-43da-9f08-50f825938444 could not be found. Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:58:05.930861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68aa76c-bae5-43da-9f08-50f825938444 could not be found. Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68aa76c-bae5-43da-9f08-50f825938444 could not be found. Jul 01 19:58:05.932022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:05.933077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Returning 404 to user: Instance a68aa76c-bae5-43da-9f08-50f825938444 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:58:05.933077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a2a90d5c-4058-4722-9575-fd65c6d84b37 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444" status: 404 len: 111 microversion: 2.1 time: 0.032887 Jul 01 19:58:05.933077 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 298/601] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:05 2022] GET /compute/v2.1/servers/a68aa76c-bae5-43da-9f08-50f825938444 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:58:05.938354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:05.938870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:05.945006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:05.945448 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:05.946243 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:05.946675 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:05.971244 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:58:06.048581 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7785f1d6-cab1-4d4f-93d4-96ca889fcfc8 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "DELETE /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 204 len: 0 microversion: 2.1 time: 0.113605 Jul 01 19:58:06.049153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 299/602] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:58:05 2022] DELETE /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:58:06.058032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:06.058729 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:06.064524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:06.064968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:06.065752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:06.066185 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:06.154316 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-53859772-df81-4acf-846b-83026ead13cd tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/action" status: 202 len: 0 microversion: 2.20 time: 0.318813 Jul 01 19:58:06.157626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 304/603] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 1 19:58:05 2022] POST /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:58:06.164491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:06.165195 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:06.171824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:06.172271 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:06.173035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:06.173464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:06.232877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:06.241211 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8cf9e0b6-3c51-462e-851d-0fea5d7ec430 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.187089 Jul 01 19:58:06.242010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 300/604] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:06 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:06.316802 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:06.325399 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:06.326944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:06.328136 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3ae85db2-4670-499d-97d1-12e6e5780e81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.168827 Jul 01 19:58:06.328694 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 305/605] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:06 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:07.258791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:07.259449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:07.265855 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:07.266292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:07.267033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:07.267488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:07.346638 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:07.347351 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:07.354136 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:07.354587 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:07.355355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:07.355791 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:07.411298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:07.418964 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-041d59b5-69d2-4a64-b388-904dfee3e3d9 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.164621 Jul 01 19:58:07.419539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 301/606] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:07 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:07.494468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:07.503418 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:07.505481 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:07.506776 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-02989353-4a91-4a9f-ab7c-704e3df21284 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.164046 Jul 01 19:58:07.507339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 306/607] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:07 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:08.436453 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:08.437059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:08.443794 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:08.444240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:08.444992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:08.445429 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:08.525986 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:08.526723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:08.533282 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:08.533777 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:08.534550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:08.535016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:08.590112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:08.598835 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4241a89c-b40c-48dc-ae1b-1d5faf299768 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.166401 Jul 01 19:58:08.599499 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 302/608] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:08 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:08.675567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:08.683822 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:08.685306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:08.686541 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2c0c3944-6811-4eb0-bc20-ee5dd646aa0e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.164794 Jul 01 19:58:08.687036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 307/609] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:08 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:09.619738 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:09.620373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:09.626937 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:09.627372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:09.628115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:09.628542 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:09.704364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:09.704892 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:09.711629 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:09.712082 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:09.712851 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:09.713291 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:09.768547 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0267350339c44000bcc49906cfa8f0a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ba0ddfd3efd41ee9687efe014c40bf0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:09.776981 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ce9feb11-3c7c-43da-9c14-a73b22d3ddc4 tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 200 len: 1522 microversion: 2.1 time: 0.162677 Jul 01 19:58:09.777569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 303/610] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:09 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:09.857252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:09.866606 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:09.868098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:09.869260 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-61d09d63-dfab-4fd3-a518-ecfdd910f3b6 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.168895 Jul 01 19:58:09.869942 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 308/611] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:09 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:10.246176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-9ee6a903-624a-4094-a62c-d0db2e05930b req-43a355dc-f7b3-4210-beff-5756f2a657dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1148781-931f-4460-a8e3-7f3654799ce7", "name": "network-vif-deleted", "tag": "c14e2e69-9a6f-4043-8f05-6857744162f2"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:10.258072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9ee6a903-624a-4094-a62c-d0db2e05930b req-43a355dc-f7b3-4210-beff-5756f2a657dc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:10.258528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9ee6a903-624a-4094-a62c-d0db2e05930b req-43a355dc-f7b3-4210-beff-5756f2a657dc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:10.272250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-9ee6a903-624a-4094-a62c-d0db2e05930b req-43a355dc-f7b3-4210-beff-5756f2a657dc service nova] Creating event network-vif-deleted:c14e2e69-9a6f-4043-8f05-6857744162f2 for instance e1148781-931f-4460-a8e3-7f3654799ce7 on hv-cinder-84460 Jul 01 19:58:10.278139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-9ee6a903-624a-4094-a62c-d0db2e05930b req-43a355dc-f7b3-4210-beff-5756f2a657dc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035936 Jul 01 19:58:10.278732 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 304/612] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:10.795276 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:10.796509 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] [instance: e1148781-931f-4460-a8e3-7f3654799ce7] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:10.804260 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:10.804704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:10.805459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:10.805915 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:10.821024 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] HTTP exception thrown: Instance e1148781-931f-4460-a8e3-7f3654799ce7 could not be found. Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Request method failure captured: Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 HTTP/1.1 Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CVZtS93PPgLkA7SnAjCSy-8tv7JQVMczG8XKUQH2Wr5Jv0Wcj7fM1JSBoBJBcnxUeEln-ujh82P1bjr4kB48_cJvgRaQ_D5wD9eHhHG8HtyxFyXD-G3eHpNaTmoPf3iicyojiK9DRAK-qkVl3Y_QZcYzIafTzQCrxNg8FnBqxaP_M Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:58:10.822693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/0ba0ddfd3efd41ee9687efe014c40bf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 0ba0ddfd3efd41ee9687efe014c40bf0 Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1358235872 Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 0267350339c44000bcc49906cfa8f0a6 Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1358235872-project Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance e1148781-931f-4460-a8e3-7f3654799ce7 could not be found. Jul 01 19:58:10.824363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'e1148781-931f-4460-a8e3-7f3654799ce7'} Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1148781-931f-4460-a8e3-7f3654799ce7 could not be found. Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:58:10.825503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1148781-931f-4460-a8e3-7f3654799ce7 could not be found. Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1148781-931f-4460-a8e3-7f3654799ce7 could not be found. Jul 01 19:58:10.827050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:10.828434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] Returning 404 to user: Instance e1148781-931f-4460-a8e3-7f3654799ce7 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:58:10.828434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7627b51a-53f8-4075-9937-65a78eb3286b tempest-ServerRescueNegativeTestJSON-1358235872 tempest-ServerRescueNegativeTestJSON-1358235872-project] 10.222.0.66 "GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7" status: 404 len: 111 microversion: 2.1 time: 0.033056 Jul 01 19:58:10.828434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 309/613] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:10 2022] GET /compute/v2.1/servers/e1148781-931f-4460-a8e3-7f3654799ce7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:58:10.887855 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:10.888540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:10.895214 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:10.896331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:10.897340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:10.897801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:11.028824 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:11.038424 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:11.039926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:11.041073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-222dc79a-a9d9-4f0f-a070-4115bf802f16 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.157406 Jul 01 19:58:11.041648 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 305/614] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:10 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:12.060014 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:12.060759 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:12.068114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:12.068559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:12.069322 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:12.069856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:12.204836 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:12.212852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:12.214380 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:12.215523 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0c7e5771-d88a-4af4-9b92-cde59aaf28c4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.159422 Jul 01 19:58:12.216075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 310/615] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:12 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:13.242342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:13.242956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:13.250016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:13.250453 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:13.251214 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:13.251640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:13.414717 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:13.425297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:13.428804 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:13.430115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-72f81526-6eb0-45d5-8650-346e46807fb8 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.199348 Jul 01 19:58:13.441183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 306/616] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:13 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:14.447725 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:14.450097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:14.456639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:14.457087 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:14.458659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:14.459279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:14.600114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:14.608230 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:14.610011 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:14.611219 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ab712f1c-20cc-44d7-9217-94fa2ee3c3cb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.167503 Jul 01 19:58:14.611770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 311/617] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:14 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:15.630265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:15.630871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:15.637372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:15.637848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:15.638608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:15.639044 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:15.782132 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:15.792075 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:15.793752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:15.794935 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-84c349e8-be4b-4f14-b6b5-19f34a43738b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.169097 Jul 01 19:58:15.797930 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 307/618] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:15 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:16.813442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:16.814198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:16.821668 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:16.822251 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:16.823092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:16.823536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:16.910083 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:16.910967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:16.917903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:16.918428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:16.919113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:16.919548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:16.948016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:58:16.968631 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:16.978055 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:16.979848 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:16.981243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-822a8d1a-4272-471b-bce6-d4c9570c8ff7 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.171587 Jul 01 19:58:16.982328 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 312/619] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:16 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:17.017023 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:17.049497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f8748d37-e73e-4c8f-ba1b-d8cd36ba994a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "DELETE /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 204 len: 0 microversion: 2.1 time: 0.142954 Jul 01 19:58:17.050437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 308/620] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:58:16 2022] DELETE /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:58:17.059477 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:17.060501 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:17.067514 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:17.068290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:17.069084 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:17.069525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:17.229075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:17.236829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-107b7deb-bcb6-4538-8c01-822d6722aa0b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1578 microversion: 2.1 time: 0.181198 Jul 01 19:58:17.240092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 313/621] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:17 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:18.001765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:18.016774 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:18.026617 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:18.030001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:18.033810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:18.034259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:18.036563 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:18.253424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:18.255285 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:18.262243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:18.262916 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:18.263865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:18.264447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:18.292933 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:18.328168 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:18.337355 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:18.339277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:18.340558 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-25a44fae-51dd-448f-8fd7-82d6b73d177f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.343946 Jul 01 19:58:18.341199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 309/622] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:17 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:18.488263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:18.497075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-491a6b0f-c88d-40ab-987a-fb90ccbafa2d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1578 microversion: 2.1 time: 0.247441 Jul 01 19:58:18.499739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 314/623] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:18 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1578 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:18.620385 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:18.620878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:18.627260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:18.627705 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:18.628674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:18.629170 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:18.655681 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-57d2c0d8-d4f8-412f-bde2-ee0ec8ac16d0 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/ips" status: 200 len: 146 microversion: 2.1 time: 0.278543 Jul 01 19:58:18.656245 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 310/624] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 19:58:18 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/ips => generated 146 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:58:19.359421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:19.360036 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:19.373784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:19.374304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:19.378039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:19.378561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:19.422845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d39fcbe1-0a43-4cc2-addd-9eee8c0ec181 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: .version_select at 0x7fa0076344c0>, body: {"keypair": {"name": "tempest-keypair-1025854016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvQgV6bAZ/kEGV2yEjdxiHc9nFYEN5m4P8vSqmXAHknTDUlB1lRX8NMbcriRIRKLCckFH5NWDqsjSNrlkyiMVzR6pVHuaszB8P7Pwzp9k41ZQwHgIuRPh7KodrtQLSICg=="}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:19.444264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-d39fcbe1-0a43-4cc2-addd-9eee8c0ec181 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:58:19.448825 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-d39fcbe1-0a43-4cc2-addd-9eee8c0ec181 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:58:19.485859 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d39fcbe1-0a43-4cc2-addd-9eee8c0ec181 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169668 Jul 01 19:58:19.486782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 315/625] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:58:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:58:19.530593 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:19.531214 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:19.550993 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:19.551634 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:19.552865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:19.553924 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:19.790076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:19.805895 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:19.808227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:19.810604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-af3d4ae4-9285-4af3-8aa5-79e008acea3a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.455054 Jul 01 19:58:19.812670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 311/626] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:19 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:19.841150 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:19.854412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4ab7472b-dc9a-4e96-b994-0e7a2528950f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1578 microversion: 2.1 time: 0.338519 Jul 01 19:58:19.864637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 316/627] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:19 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1578 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:20.123305 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:20.124762 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:20.133264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.133811 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.134902 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.135543 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.483809 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-40a9d0c2-7adb-4609-be6a-219fca3fd75e req-3bb64fde-8671-4c8d-8ebd-14a237242b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abdbc8c7-9db6-4914-8ad4-b55ee6460761", "name": "network-vif-deleted", "tag": "f9cbac97-cb1e-4639-8812-c364aa6fa31d"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:20.507939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-40a9d0c2-7adb-4609-be6a-219fca3fd75e req-3bb64fde-8671-4c8d-8ebd-14a237242b62 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.508503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-40a9d0c2-7adb-4609-be6a-219fca3fd75e req-3bb64fde-8671-4c8d-8ebd-14a237242b62 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.534998 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-40a9d0c2-7adb-4609-be6a-219fca3fd75e req-3bb64fde-8671-4c8d-8ebd-14a237242b62 service nova] Creating event network-vif-deleted:f9cbac97-cb1e-4639-8812-c364aa6fa31d for instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 on hv-cinder-84460 Jul 01 19:58:20.555118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-40a9d0c2-7adb-4609-be6a-219fca3fd75e req-3bb64fde-8671-4c8d-8ebd-14a237242b62 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187899 Jul 01 19:58:20.555829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 317/628] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:20.626149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-39329472-76f8-4491-b35c-66dab169681a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507546 Jul 01 19:58:20.633538 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 312/629] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:58:20 2022] POST /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:58:20.834129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:20.835275 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:20.846300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.847037 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.849067 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.849754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.876012 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:20.876963 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:20.892669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.894842 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.895922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.897769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.957657 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:20.958221 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:20.959092 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lazy-loading 'fault' on Instance uuid abdbc8c7-9db6-4914-8ad4-b55ee6460761 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:21.032791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:21.043056 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-aac5bb84-7f64-476f-94ee-08d78afcbfd8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 200 len: 1231 microversion: 2.1 time: 0.174025 Jul 01 19:58:21.059402 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 313/630] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:20 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 1231 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:21.147595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:21.160779 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:21.163943 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:21.168819 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-416b9667-255b-4b86-8383-8a6f042a4568 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.340822 Jul 01 19:58:21.182928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 318/631] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:20 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:21.931341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-324943209", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd301699-ca40-48e9-9559-67a73cd4bb19"}], "security_groups": [{"name": "tempest-securitygroup--2064882074"}], "key_name": "tempest-keypair-1025854016", "user_data": "}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:22.036595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] validate_networks() for [('bd301699-ca40-48e9-9559-67a73cd4bb19', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:58:22.061417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:22.062679 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:22.071997 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:22.072447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:22.073227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:22.073688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:22.092698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] HTTP exception thrown: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Request method failure captured: Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 HTTP/1.1 Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1EKpGqGuDTTZLLwHN1F-N7z6D3quDIc6jsgV8eMHYFdI1hANAEpa3SIM1cDzIxEbRTbM08rgfm0Xt7Y80U4NEe-bplO5IUbxXQOl59bfyaYm2Eu4PCikqMHeX-A5jO-pm7rrKDvsEMmZnhi50jmofKdbU-eouzn0kz0vCJpHKI52qs Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:58:22.094365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-TestVolumeBootPattern-930842922 Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-TestVolumeBootPattern-930842922-project Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 80267c31f3fc4b3fbc8dc7ed03326eeb Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-TestVolumeBootPattern-930842922-project Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 19:58:22.095921 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'abdbc8c7-9db6-4914-8ad4-b55ee6460761'} Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:58:22.096810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 19:58:22.098604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:22.099862 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Returning 404 to user: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:58:22.099862 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b28681dd-e1c9-4cfd-8ab0-01a6bb15d7fb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 404 len: 111 microversion: 2.1 time: 0.038981 Jul 01 19:58:22.109854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 319/632] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:22 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:58:22.189343 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:22.190339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:22.198244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:22.198693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:22.199466 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:22.200069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:22.376646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:22.385022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:22.386566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:22.387938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-214f3b6f-b55e-4134-be75-e09d4b7cbdf9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.203478 Jul 01 19:58:22.388656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 320/633] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:22 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:22.403671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1178320285", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1633635879", "security_groups": [{"name": "tempest-secgroup-smoke-1127916334"}], "block_device_mapping_v2": [{"uuid": "bb8ed8a3-df8a-4b9d-8aa0-ff210ced532e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8fd60a7-929d-43ab-ae8d-d1c7691811e9"}]}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:22.575358 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] validate_networks() for [('e8fd60a7-929d-43ab-ae8d-d1c7691811e9', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:58:22.599421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:58:22.600282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:58:22.600765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:58:22.601170 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:58:22.601568 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:58:22.615753 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:22.616463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:22.617769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:22.618358 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:22.636584 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:58:22.641837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:58:22.656863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:58:22.659463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:58:22.727488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-804474e0-64c9-427b-9e43-75113debb4db tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.800250 Jul 01 19:58:22.728970 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 314/634] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:58:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:58:22.744454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-23e292a8-96b7-4668-bb28-17c477502ee3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:22.746234 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-23e292a8-96b7-4668-bb28-17c477502ee3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:22.881632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-23e292a8-96b7-4668-bb28-17c477502ee3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:22.891653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-23e292a8-96b7-4668-bb28-17c477502ee3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1241 microversion: 2.1 time: 0.156522 Jul 01 19:58:22.897632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 315/635] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:22 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:23.172537 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:58:23.173032 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:58:23.173407 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:58:23.173981 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:58:23.174395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:58:23.212258 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:23.214446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:23.216022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:23.216656 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:23.246627 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for project 262e5b1a6f6248cca455437d23b8d441. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:58:23.251901 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for user 80267c31f3fc4b3fbc8dc7ed03326eeb and project 262e5b1a6f6248cca455437d23b8d441. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:58:23.335464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:58:23.337833 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb8ed8a3-df8a-4b9d-8aa0-ff210ced532e',volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:58:23.406747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:23.407348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:23.418670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:23.423467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:23.424962 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:23.425561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:23.564752 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0a2d66d1-a897-4009-b2f2-a2c6e912aa3d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.164582 Jul 01 19:58:23.566229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 321/636] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:58:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:58:23.577798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a23de737-52fc-4f73-bc58-2808e5a3bb60 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:23.578516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a23de737-52fc-4f73-bc58-2808e5a3bb60 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:23.652844 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:23.665872 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:23.667595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:23.677246 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-94e3fd8f-4fd2-4f2c-ab9a-20c639c0cc97 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.274251 Jul 01 19:58:23.677870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 316/637] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:23 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:23.708074 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a23de737-52fc-4f73-bc58-2808e5a3bb60 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:23.724900 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a23de737-52fc-4f73-bc58-2808e5a3bb60 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1095 microversion: 2.1 time: 0.147491 Jul 01 19:58:23.726302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 322/638] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:23 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1095 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:23.909564 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:23.910957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:23.921773 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:23.922226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:23.924100 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:23.924700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:24.004417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:24.015405 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-383d16d0-67e5-42f9-8a89-37847973325c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1293 microversion: 2.1 time: 0.109806 Jul 01 19:58:24.016410 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 317/639] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:23 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:24.695206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:24.695781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:24.698809 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:24.704200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:24.704647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:24.705403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:24.705872 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:24.743392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:24.744126 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:24.750632 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:24.751084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:24.751863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:24.752326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:24.831480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:24.839349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-eb1233cd-fbee-4a85-9d7b-49cbfb52cc64 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1193 microversion: 2.1 time: 0.100714 Jul 01 19:58:24.839939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 318/640] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:24 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1193 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:24.864984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:24.872860 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:24.874428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:24.875571 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-13a808b5-76f0-4f3e-92d8-e74238a5f86f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.184322 Jul 01 19:58:24.876120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 323/641] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:24 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:25.032902 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:25.033510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:25.040038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:25.040485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:25.041250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:25.041724 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:25.111655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:25.122934 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2f2a88b7-b92f-428c-a3f1-fcfdaba9bc29 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1299 microversion: 2.1 time: 0.093570 Jul 01 19:58:25.123652 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 319/642] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:25 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:25.857269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:25.857935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:25.866746 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:25.867404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:25.868342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:25.868890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:25.893142 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:25.894532 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:25.905574 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:25.906172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:25.910424 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:25.910968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:26.229635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:26.240831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8d986fe1-ec67-439c-840e-c189814ec3f2 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1279 microversion: 2.1 time: 0.387255 Jul 01 19:58:26.242188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 324/643] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:25 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1279 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:26.247768 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:26.248742 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:26.259383 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:26.260143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:26.261246 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:26.261973 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:26.266037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:26.278427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:26.281083 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:26.283483 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-27b588c7-74f7-4e29-a6a1-cafeefffecd3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1741 microversion: 2.20 time: 0.394340 Jul 01 19:58:26.286738 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 320/644] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:25 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1741 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:26.444196 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-4d909f11-87a9-446f-9813-9efe366cc531 req-636c9c19-a9d9-4374-8f4c-0606e4c8ef19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb94df28-2151-48bf-9571-ae16d23c66a6", "tag": "1a187327-634a-45da-978e-23ca2730d31b"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:26.472322 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4d909f11-87a9-446f-9813-9efe366cc531 req-636c9c19-a9d9-4374-8f4c-0606e4c8ef19 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:26.473682 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4d909f11-87a9-446f-9813-9efe366cc531 req-636c9c19-a9d9-4374-8f4c-0606e4c8ef19 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:26.485253 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-4d909f11-87a9-446f-9813-9efe366cc531 req-636c9c19-a9d9-4374-8f4c-0606e4c8ef19 service nova] Creating event network-changed:1a187327-634a-45da-978e-23ca2730d31b for instance eb94df28-2151-48bf-9571-ae16d23c66a6 on hv-cinder-84460 Jul 01 19:58:26.491796 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-4d909f11-87a9-446f-9813-9efe366cc531 req-636c9c19-a9d9-4374-8f4c-0606e4c8ef19 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057755 Jul 01 19:58:26.492396 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 321/645] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:26.542131 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:26.551748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-53fbab9a-3dd9-4c5f-9a11-cf8bd2c622e4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.308008 Jul 01 19:58:26.552348 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 325/646] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:26 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:27.043145 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-56a39c90-4328-418e-ae16-b867d86b87a7 req-27180b4a-a3db-4600-b624-dad4bcd6f1a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c2262f-a173-4336-91b1-f5f7a20bf96d", "tag": "c3aa88b7-7e29-46f3-9c4e-3618ea05e754"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:27.051880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-56a39c90-4328-418e-ae16-b867d86b87a7 req-27180b4a-a3db-4600-b624-dad4bcd6f1a8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.052325 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-56a39c90-4328-418e-ae16-b867d86b87a7 req-27180b4a-a3db-4600-b624-dad4bcd6f1a8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.065123 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-56a39c90-4328-418e-ae16-b867d86b87a7 req-27180b4a-a3db-4600-b624-dad4bcd6f1a8 service nova] Creating event network-changed:c3aa88b7-7e29-46f3-9c4e-3618ea05e754 for instance 54c2262f-a173-4336-91b1-f5f7a20bf96d on hv-cinder-84460 Jul 01 19:58:27.071127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-56a39c90-4328-418e-ae16-b867d86b87a7 req-27180b4a-a3db-4600-b624-dad4bcd6f1a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093056 Jul 01 19:58:27.071723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 322/647] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:27.258962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:27.259577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:27.267122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.267430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.268491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.269206 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.316023 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:27.318520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:27.330595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.331031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.332000 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.332576 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.555376 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:27.565737 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2eb4846b-2385-48f7-b111-4f625e7daa00 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1279 microversion: 2.1 time: 0.310466 Jul 01 19:58:27.567063 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 326/648] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:27 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1279 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:27.575750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:27.576371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:27.587192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.587649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.588649 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:27.589249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:27.624602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:27.633733 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:27.635185 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:27.636383 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-eaeb3c2c-e71a-459f-b7e4-084536da0f25 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1741 microversion: 2.20 time: 0.335955 Jul 01 19:58:27.637107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 323/649] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:27 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1741 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:27.847789 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:27.856411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a8696c3b-9d79-4299-8e60-392c476ca517 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.287946 Jul 01 19:58:27.857369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 327/650] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:27 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:28.389038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:28.390302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:28.399380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.400113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.400955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.401398 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.435965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4e224e24-ff06-443a-a03d-b8151aeb4652 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051166 Jul 01 19:58:28.440231 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 324/651] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:28 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:28.448116 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:28.449210 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:28.456004 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.456633 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.458282 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.459071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.491410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-432766ac-1a79-4559-9eef-961afdfbe97b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb" status: 200 len: 194 microversion: 2.1 time: 0.047406 Jul 01 19:58:28.497077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 328/652] 10.222.0.66 () {58 vars in 1412 bytes} [Fri Jul 1 19:58:28 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:28.587639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:28.588541 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:28.613386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.613970 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.615254 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.615995 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.655530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:28.656910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:28.668269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.671170 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.673739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.674254 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.855592 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:28.870209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9f23c293-c71d-4abb-bd4d-29674b42b85b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.288969 Jul 01 19:58:28.880407 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 325/653] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:28 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:28.885830 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:28.885959 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:28.896692 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.897089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.897899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:28.898340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:28.964681 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:28.980811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:28.982788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:28.985232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ea24a609-76ef-4d81-a405-8bb24230e2c3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.333534 Jul 01 19:58:28.986880 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 329/654] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:28 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:29.061395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:29.069115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3fafbd50-8aa4-46b2-97b2-1f23479b3596 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.187619 Jul 01 19:58:29.069933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 326/655] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:28 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:29.892263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:29.894866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:29.903717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:29.905083 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:29.906458 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:29.907075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:29.957444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b23f59ee-c4ee-4265-b364-0e0edb00c670"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:29.958744 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:29.970041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:29.970785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:29.971736 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:29.973085 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:29.977612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:30.166522 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:30.177459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8aad94ac-7686-4b54-8fa3-edded2697feb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.290128 Jul 01 19:58:30.178383 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 330/656] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:29 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:30.185287 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:30.186188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:30.211165 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:30.211708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:30.212701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:30.213308 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:30.398924 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-33875438-b5ac-40fa-828e-00d4fc7bb25f tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "POST /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446025 Jul 01 19:58:30.422385 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 327/657] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:58:29 2022] POST /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 194 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:30.493013 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:30.503163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:30.508047 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:30.509268 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5455083c-d0f0-4b1a-bdfe-0158310b02a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.329370 Jul 01 19:58:30.509877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 331/658] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:30 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:30.520000 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:30.520000 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:30.521822 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:30.522461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:30.523592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:30.524326 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:30.549477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-d21daab6-7c9b-4f17-9827-7f83df775a06 req-cdd56527-56ff-478d-87ab-4d1976ed14f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "name": "network-vif-plugged", "status": "completed", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:30.567976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-d21daab6-7c9b-4f17-9827-7f83df775a06 req-cdd56527-56ff-478d-87ab-4d1976ed14f3 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:30.570891 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-d21daab6-7c9b-4f17-9827-7f83df775a06 req-cdd56527-56ff-478d-87ab-4d1976ed14f3 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:30.605026 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-d21daab6-7c9b-4f17-9827-7f83df775a06 req-cdd56527-56ff-478d-87ab-4d1976ed14f3 service nova] Creating event network-vif-plugged:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:58:30.611087 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-d21daab6-7c9b-4f17-9827-7f83df775a06 req-cdd56527-56ff-478d-87ab-4d1976ed14f3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186365 Jul 01 19:58:30.612306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 328/659] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:30.734621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:30.743962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2859e1a4-549b-4074-8b40-61ed1582801e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.233106 Jul 01 19:58:30.753430 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 332/660] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:30 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:31.197427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:31.198877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:31.205417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:31.206210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:31.208112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:31.208903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:31.352493 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:31.361158 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-78cbc0ce-d510-4ceb-882b-1a3b6d747ef8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.168484 Jul 01 19:58:31.361801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 329/661] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:31 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:31.527724 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:31.528340 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:31.535698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:31.536398 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:31.538378 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:31.538814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:31.696700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:31.705133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:31.707372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:31.708782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ad5bc7f1-a446-477c-b18a-d30e973b8206 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.184959 Jul 01 19:58:31.719599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 333/662] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:31 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:31.762873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:31.763976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:31.776600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:31.778025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:31.778887 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:31.779421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:31.939600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:31.948524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fb71bce2-79fc-4c1f-854d-c49b765c2ebb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.191984 Jul 01 19:58:31.949428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 330/663] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:31 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:32.379810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:32.380600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:32.387609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.388059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:32.388813 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.389236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:32.551462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:32.551462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=100 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:32.557615 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-17244fee-0462-4538-a0a0-dd6e529deb02 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.182476 Jul 01 19:58:32.568119 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 334/664] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:32 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:32.628750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-4f1a8df8-81b9-4bd0-b2ae-b72ad8e0e956 req-2b225207-4c2b-449e-b3ba-51ad16aec058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb94df28-2151-48bf-9571-ae16d23c66a6", "name": "network-vif-plugged", "status": "completed", "tag": "1a187327-634a-45da-978e-23ca2730d31b"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:32.634108 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:32.640429 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4f1a8df8-81b9-4bd0-b2ae-b72ad8e0e956 req-2b225207-4c2b-449e-b3ba-51ad16aec058 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.640947 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4f1a8df8-81b9-4bd0-b2ae-b72ad8e0e956 req-2b225207-4c2b-449e-b3ba-51ad16aec058 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:32.656403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-4f1a8df8-81b9-4bd0-b2ae-b72ad8e0e956 req-2b225207-4c2b-449e-b3ba-51ad16aec058 service nova] Creating event network-vif-plugged:1a187327-634a-45da-978e-23ca2730d31b for instance eb94df28-2151-48bf-9571-ae16d23c66a6 on hv-cinder-84460 Jul 01 19:58:32.662607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-4f1a8df8-81b9-4bd0-b2ae-b72ad8e0e956 req-2b225207-4c2b-449e-b3ba-51ad16aec058 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039402 Jul 01 19:58:32.663279 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 331/665] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:32.727861 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:32.728981 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:32.737996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.739099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:32.740617 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.741612 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:32.942002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:32.951550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:32.957791 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:32.959291 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-026a43ae-7c44-4086-a9e2-ea329744de93 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.235724 Jul 01 19:58:32.965043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 335/666] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:32 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:32.976565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=8 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:32.981085 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:32.981843 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:32.990908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.991347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:32.992421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:32.993114 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.091288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-313312034"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:33.091936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:33.105621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.106155 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.107033 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.107544 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.147439 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:33.155823 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a641ef6f-f4ce-42ac-9ba8-1f97278c3b8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.180851 Jul 01 19:58:33.165614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 332/667] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:32 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:33.231949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:33.279524 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.network.security_group_api [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Removing security group dce35b76-89c6-423c-8cb8-9feb2fe13b2a from port 8c1bb424-3191-4a82-8472-b2d89cf9baca Jul 01 19:58:33.575812 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:33.576771 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:33.585307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.585743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.586526 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.586963 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.715734 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=12 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:33.820898 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9d772a7e-ebae-4e58-8406-c082d3e89ca2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/action" status: 202 len: 0 microversion: 2.1 time: 0.734581 Jul 01 19:58:33.822149 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 336/668] 10.222.0.66 () {60 vars in 1277 bytes} [Fri Jul 1 19:58:33 2022] POST /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 01 19:58:33.835363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-ef65ac6f-c289-4dd1-887a-e87840be8bb1 req-5dc30d4e-29f3-4f86-a493-d45f9640634f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:33.856359 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-ef65ac6f-c289-4dd1-887a-e87840be8bb1 req-5dc30d4e-29f3-4f86-a493-d45f9640634f service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.856797 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-ef65ac6f-c289-4dd1-887a-e87840be8bb1 req-5dc30d4e-29f3-4f86-a493-d45f9640634f service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.888798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-ef65ac6f-c289-4dd1-887a-e87840be8bb1 req-5dc30d4e-29f3-4f86-a493-d45f9640634f service nova] Creating event network-changed:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:58:33.897801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-ef65ac6f-c289-4dd1-887a-e87840be8bb1 req-5dc30d4e-29f3-4f86-a493-d45f9640634f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066698 Jul 01 19:58:33.903373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:33.921303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-671768aa-58b6-4511-90be-e60469c43cc6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.349444 Jul 01 19:58:33.929819 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 337/669] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:58:33.930551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 333/670] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:33 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:33.980181 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:33.981309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:33.992153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.995235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:33.996383 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:33.998979 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:34.174526 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:34.177908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:34.190165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:34.191591 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:34.193012 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:34.193611 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:34.786105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:34.800244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:34.804695 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:34.813873 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f3a944e9-8578-41c2-9c30-d1706f30e9f5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.831626 Jul 01 19:58:34.822040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:34.828332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 338/671] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:33 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:34.830195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5f2009ad-0eae-480f-92a8-5140901c123f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1367 microversion: 2.1 time: 0.659397 Jul 01 19:58:34.831865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 334/672] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:34 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1367 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:34.945890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:34.946505 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:34.952725 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:34.953177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:34.954501 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:34.955141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:35.186890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:35.195701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-589a04a5-56b3-421b-9616-ad878e31928e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.253729 Jul 01 19:58:35.196279 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 339/673] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:34 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:35.832823 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:35.834240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:35.848780 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:35.849007 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:35.849625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:35.850161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:35.850879 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:35.851516 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:35.857099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:35.857542 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:35.858330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:35.858944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.219371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:36.228912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-098a7dbc-0c0d-4e13-92c3-78945c72be52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1557 microversion: 2.1 time: 0.384397 Jul 01 19:58:36.230190 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 340/674] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:35 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1557 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:36.230322 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:36.237396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:36.238868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:36.241155 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:36.242914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:36.244326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4c94b108-9320-4328-a816-efa3c0a474f1 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.416082 Jul 01 19:58:36.245502 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 335/675] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:35 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:36.257317 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.258090 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.258990 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.260469 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-b8afe766-2f61-4e1d-ad38-06fbc3fe553e req-3c4f949c-13d7-430c-b6a1-0b8591fd3aeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:36.260641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.272901 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b8afe766-2f61-4e1d-ad38-06fbc3fe553e req-3c4f949c-13d7-430c-b6a1-0b8591fd3aeb service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.273642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b8afe766-2f61-4e1d-ad38-06fbc3fe553e req-3c4f949c-13d7-430c-b6a1-0b8591fd3aeb service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.291624 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-b8afe766-2f61-4e1d-ad38-06fbc3fe553e req-3c4f949c-13d7-430c-b6a1-0b8591fd3aeb service nova] Creating event network-changed:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:58:36.305865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-b8afe766-2f61-4e1d-ad38-06fbc3fe553e req-3c4f949c-13d7-430c-b6a1-0b8591fd3aeb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057232 Jul 01 19:58:36.306476 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 336/676] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:36.313765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:36.314759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:36.323522 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.324298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.325323 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.326785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.381895 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lazy-loading 'services' on Instance uuid 58add3b8-fd7b-4911-91bd-328d58945ac9 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:36.484711 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-01b444bd-fd47-47ae-a4a3-d16beb7fa793 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments/bbbf0184-6d55-4425-bade-9dfa3824aca2" status: 202 len: 0 microversion: 2.1 time: 0.252794 Jul 01 19:58:36.492605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 341/677] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:58:36 2022] DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments/bbbf0184-6d55-4425-bade-9dfa3824aca2 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:58:36.502888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:36.502888 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:36.512198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.512900 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.513473 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.514229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.545425 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:36.560618 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3a14d6fc-16dc-419d-bd89-e4ad3c35f612 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.252635 Jul 01 19:58:36.561466 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 337/678] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:36 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:36.588385 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:36.589701 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:36.605408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.611628 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.614804 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:36.618192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:36.642144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b3778833-2ad6-4ee7-91be-e68d0034690f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147501 Jul 01 19:58:36.642512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 342/679] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 19:58:36 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:36.717080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c5362d0e-56fc-4fde-a6c4-42d37c69ac65 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154200 Jul 01 19:58:36.723099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 338/680] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:36 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:37.263804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:37.265434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:37.278194 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.279985 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:37.284930 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.286289 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:37.578863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:37.581217 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:37.592352 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.593041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:37.600363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.601040 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:37.617908 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:37.627103 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:37.631747 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:37.635200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-07009a85-6fcd-44f5-a53f-e9306d68845d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.375739 Jul 01 19:58:37.637939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 343/681] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:37 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:37.730634 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:37.731372 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:37.757512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.760754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:37.761672 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.762111 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:37.841229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f572bc27-7a76-45cf-818b-c865af0083fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115608 Jul 01 19:58:37.848466 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 344/682] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:37 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:37.850646 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:37.860820 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-478a64f5-1bb0-4766-b55d-12d78ff5c138 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.286906 Jul 01 19:58:37.871444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 339/683] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:37 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:37.927423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-39b17795-addf-4ee6-a0cc-d9978aaa8d4f req-6dad7125-c9af-4e49-b923-780364430b7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb94df28-2151-48bf-9571-ae16d23c66a6", "tag": "1a187327-634a-45da-978e-23ca2730d31b"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:37.954005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-39b17795-addf-4ee6-a0cc-d9978aaa8d4f req-6dad7125-c9af-4e49-b923-780364430b7d service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:37.954450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-39b17795-addf-4ee6-a0cc-d9978aaa8d4f req-6dad7125-c9af-4e49-b923-780364430b7d service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.002810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-39b17795-addf-4ee6-a0cc-d9978aaa8d4f req-6dad7125-c9af-4e49-b923-780364430b7d service nova] Creating event network-changed:1a187327-634a-45da-978e-23ca2730d31b for instance eb94df28-2151-48bf-9571-ae16d23c66a6 on hv-cinder-84460 Jul 01 19:58:38.016516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-39b17795-addf-4ee6-a0cc-d9978aaa8d4f req-6dad7125-c9af-4e49-b923-780364430b7d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096892 Jul 01 19:58:38.017324 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 345/684] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:38.253968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:38.255088 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:38.263818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.264300 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.265521 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.266121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.310633 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-151968af-1aff-4bbe-819c-c8e7fad336df tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062178 Jul 01 19:58:38.311580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 340/685] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:38 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:38.471374 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:38.472709 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:38.490582 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.491033 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.491821 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.492287 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.612996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-872ecdc5-e167-4f7a-8e66-f810954fe274 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb" status: 200 len: 194 microversion: 2.1 time: 0.147588 Jul 01 19:58:38.618199 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 346/686] 10.222.0.66 () {58 vars in 1412 bytes} [Fri Jul 1 19:58:38 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb => generated 194 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:38.630668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:38.631500 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:38.648644 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.649696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.651227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.652093 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.656124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:38.656741 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:38.676301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.677113 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.678281 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.680535 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.775562 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lazy-loading 'services' on Instance uuid 81be27a4-51b0-4fa6-8e9b-003575784817 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:38.932868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ef10c537-a252-4e33-9cf0-d8e7991be8c1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb" status: 202 len: 0 microversion: 2.1 time: 0.307763 Jul 01 19:58:38.934117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 341/687] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:58:38 2022] DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/e57f01b6-a0c3-4e96-a5b5-e6a484d1d5cb => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:58:38.960403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:38.975010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:38.982457 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.983184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:38.984177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:38.984806 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:39.057863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a9e80e2d-6574-46ba-b58f-a9e7680c48ca tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.122274 Jul 01 19:58:39.063628 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 342/688] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:38 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments => generated 25 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:58:39.073661 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:39.075968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:39.076880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:39.087559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:39.089057 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:39.090260 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2e4ed960-48e4-4bb7-9087-dd1a2fab1495 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.438053 Jul 01 19:58:39.090819 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 347/689] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:38 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:39.094717 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:39.095493 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:39.096280 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:39.096814 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:39.115017 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:39.115792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:39.122850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:39.123302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:39.124070 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:39.124502 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:39.269748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] HTTP exception thrown: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 is not attached to volume bbbf0184-6d55-4425-bade-9dfa3824aca2 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Request method failure captured: Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments/bbbf0184-6d55-4425-bade-9dfa3824aca2 HTTP/1.1 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1FZMqElIXTBetBa0HjdTKOTrP_Y2zZLZM3Lwim0AtFDtOE4m5DahB2wBoRgRTLTGNjkqv4OinQbkJeXbYFgK0ryvvnDhF8vWOf0yQ_pUrJgBC7mLr1tR18wmAm_MNLVCKXMMIszCea3fP_rJKedxYUpYnPONHtj1Z5uerwiKJ6sGDk Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: e33de0b0c3244c78a86fbfda1c9fbdd6 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-TestMinimumBasicScenario-1009518287 Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:58:39.273748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-TestMinimumBasicScenario-1009518287 Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: e33de0b0c3244c78a86fbfda1c9fbdd6 Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1009518287 Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-TestMinimumBasicScenario-1009518287-project Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: d4ef9ec1904d4e76ae1cd1dc197e4f41 Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-TestMinimumBasicScenario-1009518287-project Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:58:39.275160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 is not attached to volume bbbf0184-6d55-4425-bade-9dfa3824aca2 Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'server_id': '58add3b8-fd7b-4911-91bd-328d58945ac9', 'id': 'bbbf0184-6d55-4425-bade-9dfa3824aca2'} Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bbbf0184-6d55-4425-bade-9dfa3824aca2. Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:58:39.275887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 is not attached to volume bbbf0184-6d55-4425-bade-9dfa3824aca2 Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 is not attached to volume bbbf0184-6d55-4425-bade-9dfa3824aca2 Jul 01 19:58:39.277069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:58:39.279465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Returning 404 to user: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 is not attached to volume bbbf0184-6d55-4425-bade-9dfa3824aca2 {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:58:39.280550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7b0daa1a-a1e0-4935-af74-951c4b19089e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments/bbbf0184-6d55-4425-bade-9dfa3824aca2" status: 404 len: 154 microversion: 2.1 time: 0.188829 Jul 01 19:58:39.281855 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 348/690] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:58:39 2022] DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9/os-volume_attachments/bbbf0184-6d55-4425-bade-9dfa3824aca2 => generated 154 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:58:39.332294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:39.341342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:39.372566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-177c52e2-9da8-4917-9936-652315e486b0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.305651 Jul 01 19:58:39.384369 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 343/691] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:39 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:40.109207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:40.109933 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:40.117532 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.118147 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.118929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.119357 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.256121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:40.264057 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:40.265462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:40.266639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6e3720ae-f800-4ff8-8beb-2e3727bc0a9f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1736 microversion: 2.20 time: 0.162212 Jul 01 19:58:40.267186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 349/692] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:40 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:40.392434 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:40.393234 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:40.403782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.404315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.405110 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.405545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.470972 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:40.472330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:40.478765 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.479536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.480559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.487072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.530559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:58:40.580910 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:40.589684 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f5e625c4-61da-4484-882e-1f5107a38e1b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.201577 Jul 01 19:58:40.591399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 344/693] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:40 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:40.633325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c016c8a2-3513-4c1f-a750-9968bc33e311 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 204 len: 0 microversion: 2.1 time: 0.165146 Jul 01 19:58:40.634236 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 350/694] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:58:40 2022] DELETE /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:58:40.645194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:40.646016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:40.652419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.652948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.654417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.654822 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.657260 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-41dfa909-0b2f-474a-83d6-908b76df5a7f req-497339c0-d7ba-4428-8690-13a17a18cf04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c2262f-a173-4336-91b1-f5f7a20bf96d", "name": "network-vif-plugged", "status": "completed", "tag": "c3aa88b7-7e29-46f3-9c4e-3618ea05e754"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:40.668723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-41dfa909-0b2f-474a-83d6-908b76df5a7f req-497339c0-d7ba-4428-8690-13a17a18cf04 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:40.669311 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-41dfa909-0b2f-474a-83d6-908b76df5a7f req-497339c0-d7ba-4428-8690-13a17a18cf04 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:40.681728 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:40.684018 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-41dfa909-0b2f-474a-83d6-908b76df5a7f req-497339c0-d7ba-4428-8690-13a17a18cf04 service nova] Creating event network-vif-plugged:c3aa88b7-7e29-46f3-9c4e-3618ea05e754 for instance 54c2262f-a173-4336-91b1-f5f7a20bf96d on hv-cinder-84460 Jul 01 19:58:40.690113 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-41dfa909-0b2f-474a-83d6-908b76df5a7f req-497339c0-d7ba-4428-8690-13a17a18cf04 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040956 Jul 01 19:58:40.691685 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 351/695] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:40.804194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:40.812401 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e8c2b334-04e8-4823-864b-5e22baed43fb tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1554 microversion: 2.1 time: 0.173825 Jul 01 19:58:40.813016 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 345/696] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:40 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1554 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:41.178036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:41.178608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:41.185334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.185810 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.186560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.186992 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.214773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-32045a6e-862b-483e-bf0c-99bae23f0a0d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/b23f59ee-c4ee-4265-b364-0e0edb00c670" status: 200 len: 194 microversion: 2.1 time: 0.042855 Jul 01 19:58:41.215337 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 352/697] 10.222.0.66 () {58 vars in 1412 bytes} [Fri Jul 1 19:58:41 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/b23f59ee-c4ee-4265-b364-0e0edb00c670 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:41.225605 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:41.226101 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:41.232169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.232617 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.233376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.233834 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.286336 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:41.286951 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:41.293188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.293367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.294177 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.294621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.316512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lazy-loading 'services' on Instance uuid 81be27a4-51b0-4fa6-8e9b-003575784817 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:41.388993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c6be01a4-986e-4804-83f2-433640dc5a3d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/b23f59ee-c4ee-4265-b364-0e0edb00c670" status: 202 len: 0 microversion: 2.1 time: 0.167614 Jul 01 19:58:41.389614 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 346/698] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 19:58:41 2022] DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments/b23f59ee-c4ee-4265-b364-0e0edb00c670 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:58:41.440095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:41.448377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:41.449894 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:41.451050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-151b1c95-a835-40fb-bf59-408cc7fe9079 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1718 microversion: 2.20 time: 0.169795 Jul 01 19:58:41.451588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 353/699] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:41 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1718 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:41.609098 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:41.609750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:41.616653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.617094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.617867 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.618298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.752127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:41.760073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1e963ae3-0e78-4010-a7ca-0ea105f2d66c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.155665 Jul 01 19:58:41.760640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 347/700] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:41 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:41.830536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:41.831832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:41.838021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.838467 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.839232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:41.839668 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:41.966626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:41.974586 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a540fb93-dad6-41db-89f2-f6ec20db55c2 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1554 microversion: 2.1 time: 0.148018 Jul 01 19:58:41.975141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 354/701] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:41 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:42.469419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:42.470065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:42.476974 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:42.477415 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:42.478201 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:42.478628 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:42.613821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:42.621553 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:42.623067 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:42.624246 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7c317c7e-3dbe-4c6f-b1c6-11c58c48a2a3 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1718 microversion: 2.20 time: 0.158684 Jul 01 19:58:42.624806 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 348/702] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:42 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:42.777141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:42.777782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:42.784876 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:42.785326 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:42.786117 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:42.786554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:42.922397 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:42.930677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a2223bc9-f846-4810-a5fc-fdd0bd1c9ceb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.157350 Jul 01 19:58:42.931242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 355/703] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:42 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:42.992380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:42.993065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:42.995093 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:43.001316 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.001817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.002587 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.003785 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.464498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:43.472410 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f6c34eeb-8d82-4153-88f6-f31eaf1ccea4 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1554 microversion: 2.1 time: 0.483851 Jul 01 19:58:43.472983 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 349/704] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:42 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1554 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:43.613860 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:43.615098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:43.621162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.621643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.622406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.622841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.641391 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:43.642606 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:43.650026 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.650706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.651480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.651922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.654163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-621e0f8e-c765-43e5-aa57-76c767bc85d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044799 Jul 01 19:58:43.658248 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 356/705] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:43 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:43.790171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-bd765907-cc28-480f-87cc-2ae0a238d56f req-38b00bd4-6267-4fff-92ee-0226d519392c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58add3b8-fd7b-4911-91bd-328d58945ac9", "name": "network-vif-deleted", "tag": "8c1bb424-3191-4a82-8472-b2d89cf9baca"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:43.798720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-bd765907-cc28-480f-87cc-2ae0a238d56f req-38b00bd4-6267-4fff-92ee-0226d519392c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.799159 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-bd765907-cc28-480f-87cc-2ae0a238d56f req-38b00bd4-6267-4fff-92ee-0226d519392c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.810387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-bd765907-cc28-480f-87cc-2ae0a238d56f req-38b00bd4-6267-4fff-92ee-0226d519392c service nova] Creating event network-vif-deleted:8c1bb424-3191-4a82-8472-b2d89cf9baca for instance 58add3b8-fd7b-4911-91bd-328d58945ac9 on hv-cinder-84460 Jul 01 19:58:43.815278 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-bd765907-cc28-480f-87cc-2ae0a238d56f req-38b00bd4-6267-4fff-92ee-0226d519392c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028658 Jul 01 19:58:43.816218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 357/706] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:58:43.850341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:43.858530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:43.860025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:43.861181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d1fe5631-cf5d-48df-aaf6-765e6f6a2c90 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1718 microversion: 2.20 time: 0.223631 Jul 01 19:58:43.861773 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 350/707] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:43 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1718 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:43.947708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:43.948409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:43.954691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.955141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:43.956393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:43.956838 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.091490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:44.099981 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4d16e44b-7fee-425e-a26e-32736cdcfc2b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1267 microversion: 2.1 time: 0.156395 Jul 01 19:58:44.100621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 358/708] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:43 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:44.489859 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:44.490580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:44.497117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.497667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.498466 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.498901 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.539534 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-0e48252e-c5a9-4d17-be31-69935376cff6 req-cd0ab387-42ea-409a-b2a4-4984cb0fdb2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "name": "network-vif-unplugged", "status": "completed", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:44.548252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-0e48252e-c5a9-4d17-be31-69935376cff6 req-cd0ab387-42ea-409a-b2a4-4984cb0fdb2a service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.548875 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-0e48252e-c5a9-4d17-be31-69935376cff6 req-cd0ab387-42ea-409a-b2a4-4984cb0fdb2a service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.566601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-0e48252e-c5a9-4d17-be31-69935376cff6 req-cd0ab387-42ea-409a-b2a4-4984cb0fdb2a service nova] Creating event network-vif-unplugged:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:58:44.571796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-0e48252e-c5a9-4d17-be31-69935376cff6 req-cd0ab387-42ea-409a-b2a4-4984cb0fdb2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036012 Jul 01 19:58:44.572400 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 359/709] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:44.578707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:44.586870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7f4e810d-1760-436a-a66f-74b266b2c789 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1343 microversion: 2.1 time: 0.101163 Jul 01 19:58:44.587449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 351/710] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:44 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1343 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:44.666406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:44.667477 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:44.673719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.674200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.675312 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.675743 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.705724 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1b0a6e86-6892-4bb1-9671-c5076c33a8d8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043548 Jul 01 19:58:44.706825 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 360/711] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:44 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:44.878559 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:44.879716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:44.886840 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.887297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:44.888075 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:44.888513 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.037788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:45.045663 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:45.047149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:45.048294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1f64c23d-76dd-42e9-bde8-981df809d7a5 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1721 microversion: 2.20 time: 0.173701 Jul 01 19:58:45.048849 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 352/712] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:44 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:45.066741 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73c10678-e56a-42ad-8a3a-aa77f6ade328"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:45.067803 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.074009 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.074463 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.075229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.075661 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.116624 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:45.117232 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.123212 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.123788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.124408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.124838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.270441 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:45.279044 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f901e97d-f09a-4669-a92d-5cc31e3dd0c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1453 microversion: 2.1 time: 0.166802 Jul 01 19:58:45.279752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 353/713] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:45 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1453 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:45.296194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:45.296908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.304191 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.304636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.305404 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.305888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.395941 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2505232e-c9d5-445f-8408-db561fb1cb77 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.333308 Jul 01 19:58:45.401346 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 361/714] 10.222.0.66 () {62 vars in 1363 bytes} [Fri Jul 1 19:58:45 2022] POST /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-volume_attachments => generated 188 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 01 19:58:45.464115 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:45.471707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-6dfeb93a-6db7-45ab-94f1-cce44d6e80fc tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1453 microversion: 2.1 time: 0.179347 Jul 01 19:58:45.472449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 354/715] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:45 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:45.522273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:45.522774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.532085 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.532889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.533829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.534424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.603236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:45.603853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.611608 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.612699 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.613600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.614038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.646396 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.646842 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.647296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lazy-loading 'fault' on Instance uuid 58add3b8-fd7b-4911-91bd-328d58945ac9 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:58:45.706581 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4ef9ec1904d4e76ae1cd1dc197e4f41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e33de0b0c3244c78a86fbfda1c9fbdd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:45.714523 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-33cd06bf-50ba-4e53-b574-696a001929e0 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 200 len: 1348 microversion: 2.1 time: 0.115181 Jul 01 19:58:45.716092 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 355/716] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:45 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 1348 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:45.721404 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:45.722569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.728845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.729293 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.730093 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.730650 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.762342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-29acc0ec-9e73-4511-be53-f09765c997b8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045036 Jul 01 19:58:45.763242 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 356/717] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:45 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 19:58:45.812518 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d47a7e43-7075-481c-ab8f-d5beef594d29 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-volume_attachments/73c10678-e56a-42ad-8a3a-aa77f6ade328" status: 202 len: 0 microversion: 2.20 time: 0.297508 Jul 01 19:58:45.813459 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 362/718] 10.222.0.66 () {60 vars in 1456 bytes} [Fri Jul 1 19:58:45 2022] DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-volume_attachments/73c10678-e56a-42ad-8a3a-aa77f6ade328 => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:58:45.882463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:45.883869 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.891596 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.892409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.892937 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:45.894194 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:45.894756 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.895637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.900487 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.901992 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.901992 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:45.902180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:45.935288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a1d1b48c-6957-4237-836b-27ea92c59700 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045666 Jul 01 19:58:45.938368 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 363/719] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 19:58:45 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 01 19:58:46.012187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:46.013042 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:46.022860 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.024312 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.025373 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.026079 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.057619 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:58:46.063932 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:46.152162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bc0d07d2-08c7-4c98-9ad5-da341c7ab285 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 204 len: 0 microversion: 2.1 time: 0.144584 Jul 01 19:58:46.153854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 364/720] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:58:46 2022] DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 19:58:46.164164 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:46.165961 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:46.174004 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.174475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.175446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.176048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.199639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1c546644-38df-4f74-aa83-55782e0da43e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "POST /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/action" status: 202 len: 0 microversion: 2.20 time: 0.325583 Jul 01 19:58:46.200622 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 357/721] 10.222.0.66 () {62 vars in 1318 bytes} [Fri Jul 1 19:58:45 2022] POST /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:58:46.209261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:46.210063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:46.216659 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.217436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.218437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.218956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.241409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:46.561335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:46.570071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:46.571586 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:46.573087 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:46.574290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f6f11304-58ee-4621-a770-48a6051c79f0 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1669 microversion: 2.20 time: 0.369781 Jul 01 19:58:46.580548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 358/722] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:46 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1669 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:46.581016 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2867fc7e-c0b6-4e3e-a233-62500ff07857 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1672 microversion: 2.1 time: 0.422178 Jul 01 19:58:46.581734 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 365/723] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:46 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1672 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:46.732125 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:46.732734 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] [instance: 58add3b8-fd7b-4911-91bd-328d58945ac9] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:46.739720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.740170 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.740943 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:46.741420 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:46.770898 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] HTTP exception thrown: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 could not be found. Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Request method failure captured: Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 HTTP/1.1 Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1FZMqElIXTBetBa0HjdTKOTrP_Y2zZLZM3Lwim0AtFDtOE4m5DahB2wBoRgRTLTGNjkqv4OinQbkJeXbYFgK0ryvvnDhF8vWOf0yQ_pUrJgBC7mLr1tR18wmAm_MNLVCKXMMIszCea3fP_rJKedxYUpYnPONHtj1Z5uerwiKJ6sGDk Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: e33de0b0c3244c78a86fbfda1c9fbdd6 Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-TestMinimumBasicScenario-1009518287 Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:58:46.772979 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/e33de0b0c3244c78a86fbfda1c9fbdd6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-TestMinimumBasicScenario-1009518287 Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: e33de0b0c3244c78a86fbfda1c9fbdd6 Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1009518287 Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-TestMinimumBasicScenario-1009518287-project Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: d4ef9ec1904d4e76ae1cd1dc197e4f41 Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-TestMinimumBasicScenario-1009518287-project Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 could not be found. Jul 01 19:58:46.774545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '58add3b8-fd7b-4911-91bd-328d58945ac9'} Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 could not be found. Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:58:46.775528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 could not be found. Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 could not be found. Jul 01 19:58:46.776945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:58:46.778379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Returning 404 to user: Instance 58add3b8-fd7b-4911-91bd-328d58945ac9 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:58:46.778379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-072eeb6c-786e-4487-abe5-9867aaa2c1d9 tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9" status: 404 len: 111 microversion: 2.1 time: 0.046186 Jul 01 19:58:46.778379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 359/724] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:46 2022] GET /compute/v2.1/servers/58add3b8-fd7b-4911-91bd-328d58945ac9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:58:46.786980 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6ad2326e-89cc-4fb1-84ea-fd5f26a8345e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] Calling method '.version_select at 0x7fa007567a60>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:46.798445 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:58:46.808772 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6ad2326e-89cc-4fb1-84ea-fd5f26a8345e tempest-TestMinimumBasicScenario-1009518287 tempest-TestMinimumBasicScenario-1009518287-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1416444649" status: 202 len: 0 microversion: 2.1 time: 0.025652 Jul 01 19:58:46.809475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 366/725] 10.222.0.66 () {58 vars in 1271 bytes} [Fri Jul 1 19:58:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1416444649 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:58:47.592883 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:47.593637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:47.601226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:47.601813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:47.602651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:47.603263 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:47.604496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:47.605110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:47.611128 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:47.611577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:47.613797 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:47.614235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:48.358280 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:48.370168 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-365b3840-4035-42bb-8dd2-7fb25c13dd2d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1672 microversion: 2.1 time: 0.770003 Jul 01 19:58:48.382478 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 367/726] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:47 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1672 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:58:48.388823 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-6beebefa-78bc-4d62-8f1f-dce8ea7fc305 req-d1a0667d-3915-4998-a9e2-3bf0208f16cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c2262f-a173-4336-91b1-f5f7a20bf96d", "tag": "c3aa88b7-7e29-46f3-9c4e-3618ea05e754"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:48.395876 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:48.400715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-6beebefa-78bc-4d62-8f1f-dce8ea7fc305 req-d1a0667d-3915-4998-a9e2-3bf0208f16cb service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:48.401434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-6beebefa-78bc-4d62-8f1f-dce8ea7fc305 req-d1a0667d-3915-4998-a9e2-3bf0208f16cb service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:48.413857 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:48.418711 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-6beebefa-78bc-4d62-8f1f-dce8ea7fc305 req-d1a0667d-3915-4998-a9e2-3bf0208f16cb service nova] Creating event network-changed:c3aa88b7-7e29-46f3-9c4e-3618ea05e754 for instance 54c2262f-a173-4336-91b1-f5f7a20bf96d on hv-cinder-84460 Jul 01 19:58:48.418899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:48.423777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fbef873d-79b5-4f50-97ba-66bcb108655d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1669 microversion: 2.20 time: 0.834845 Jul 01 19:58:48.425228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 360/727] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:47 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1669 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:48.427060 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-6beebefa-78bc-4d62-8f1f-dce8ea7fc305 req-d1a0667d-3915-4998-a9e2-3bf0208f16cb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042783 Jul 01 19:58:48.427852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 368/728] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:49.391105 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:49.391813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:49.402437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:49.403143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:49.403919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:49.404575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:49.445706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:49.448942 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:49.463848 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:49.465978 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:49.467845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:49.470255 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:49.915914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:49.925235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:49.928417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a9b1f83a-d47d-4953-9316-55cb6f9f52b7 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1672 microversion: 2.1 time: 0.543302 Jul 01 19:58:49.929358 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 361/729] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:49 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1672 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:49.935267 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:49.938552 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:49.940556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9c374234-1137-45fe-8f06-b612648cff1c tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.500230 Jul 01 19:58:49.941310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 369/730] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:49 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:50.625356 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-51c02ac1-6ac8-4f53-90fa-72d734233e91 req-f9e12894-95a1-475f-a36a-b737cf6d13cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81be27a4-51b0-4fa6-8e9b-003575784817", "name": "network-vif-deleted", "tag": "60d81827-fc49-4b52-8bdd-57665e59e05d"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:58:50.634949 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-51c02ac1-6ac8-4f53-90fa-72d734233e91 req-f9e12894-95a1-475f-a36a-b737cf6d13cc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:50.635487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-51c02ac1-6ac8-4f53-90fa-72d734233e91 req-f9e12894-95a1-475f-a36a-b737cf6d13cc service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:50.648357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-51c02ac1-6ac8-4f53-90fa-72d734233e91 req-f9e12894-95a1-475f-a36a-b737cf6d13cc service nova] Creating event network-vif-deleted:60d81827-fc49-4b52-8bdd-57665e59e05d for instance 81be27a4-51b0-4fa6-8e9b-003575784817 on hv-cinder-84460 Jul 01 19:58:50.654024 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-51c02ac1-6ac8-4f53-90fa-72d734233e91 req-f9e12894-95a1-475f-a36a-b737cf6d13cc service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035389 Jul 01 19:58:50.654757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 362/731] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:58:50.945956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:50.946568 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:50.959396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:50.959839 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:50.960616 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:50.961048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:50.963030 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:50.964184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:50.973403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:50.974027 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:50.975257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:50.975807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:51.091020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:51.101756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8252b2e8-2707-4162-b5a7-357781813691 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.157602 Jul 01 19:58:51.103574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 370/732] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:50 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:51.401394 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:51.416177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:51.423853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:51.425922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e3c60891-078a-414e-b6d4-50f126b23d74 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.468458 Jul 01 19:58:51.436126 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 363/733] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:50 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:52.120738 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:52.121441 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:52.128726 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:52.129487 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:52.130494 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:52.131122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:52.244252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:52.253390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ff7cc3ed-9ebc-4e1a-b855-7f06a49ebd9d tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.137961 Jul 01 19:58:52.255188 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 371/734] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:52 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:52.444749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:52.448543 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:52.463263 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:52.464588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:52.465562 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:52.466527 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:52.687589 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:52.702551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:52.708395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:52.714383 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-356d0ffb-7677-4802-81b5-6580f75cb913 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.274542 Jul 01 19:58:52.715174 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 364/735] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:52 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:53.273997 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:53.275207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:53.301929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:53.302435 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:53.303214 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:53.303688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:53.418531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:53.434553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f596723d-91c2-4e4a-9cfb-bdbf02b56c8e tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.163423 Jul 01 19:58:53.435801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 372/736] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:53 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:53.733834 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:53.734461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:53.742440 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:53.743148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:53.744103 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:53.744855 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:53.929022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:53.945321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:53.947235 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:53.948534 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a4d19dc0-c703-4ec6-88e7-977c560a8b0b tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.218971 Jul 01 19:58:53.949222 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 365/737] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:53 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:54.452360 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:54.453844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:54.461166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:54.461631 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:54.462596 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:54.463385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:54.565228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:54.574422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2c27f38e-436b-4fcc-95e1-5d676eedf279 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.125131 Jul 01 19:58:54.584164 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 373/738] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:54 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:54.969610 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:54.971561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:54.979084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:54.979534 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:54.980306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:54.980743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:55.154318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:55.164806 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:55.166350 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:55.167694 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-04310cff-8ad3-431a-9770-780ff70dbfdf tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.203137 Jul 01 19:58:55.168245 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 366/739] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:54 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:55.595559 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:55.596316 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:55.603332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:55.604160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:55.605103 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:55.605719 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:55.723336 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:55.732958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bea9a558-1d6b-4dc0-9316-f8e60cadf3c8 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.144835 Jul 01 19:58:55.733844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 374/740] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:55 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:56.192128 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:56.193350 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:56.200440 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:56.201132 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:56.202123 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:56.202706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:56.439316 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:56.451172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:56.454120 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:56.456122 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e2ee7a53-f2fe-440b-a55e-593ceee7cc59 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.268751 Jul 01 19:58:56.459914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 367/741] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:56 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:56.752503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:56.753189 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:56.760695 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:56.761054 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:56.761929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:56.762823 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:56.868764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:56.886805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-37328006-e8e6-4007-aea3-5cffd4471abb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.133077 Jul 01 19:58:56.889546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 375/742] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:56 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:57.476930 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:57.478052 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:57.485685 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:57.486417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:57.487202 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:57.487641 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:57.663987 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:57.673372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:57.676389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:57.677990 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a5b7d2f4-9d65-47cf-b621-e1c836085f2e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.204853 Jul 01 19:58:57.679079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 368/743] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:57 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:58:57.907515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:57.908269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:57.915805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:57.916263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:57.917040 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:57.917479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:57.996258 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:58.006858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d5a418dc-0f61-416a-818e-d335c1319305 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.103927 Jul 01 19:58:58.007732 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 376/744] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:57 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:58.697671 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:58.698251 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:58.705642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:58.706098 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:58.707075 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:58.711149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:58.865423 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:58.873843 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:58.875405 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:58.876631 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5c4a9be4-ebd5-41f1-b650-d0905609b2aa tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.183139 Jul 01 19:58:58.877388 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 369/745] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:58 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:58:59.024912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:59.025530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:59.032037 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:59.032486 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:59.033774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:59.034213 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:59.100547 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:58:59.108162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-363fb19a-85e5-4710-8e0a-075f8b9735e9 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1605 microversion: 2.1 time: 0.087328 Jul 01 19:58:59.108745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 377/746] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:58:59 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:58:59.893852 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:58:59.894541 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:58:59.901260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:59.901730 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:58:59.902485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:58:59.902925 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:00.034357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:00.042498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:00.043988 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:00.045131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-00c5d79d-633c-4bba-9309-89fbfc8a7a31 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.155272 Jul 01 19:59:00.045710 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 370/747] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:58:59 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:00.126054 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:00.126796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:00.133889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:00.134340 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:00.135095 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:00.135530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:00.165521 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:00.166000 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:00.166442 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lazy-loading 'fault' on Instance uuid 81be27a4-51b0-4fa6-8e9b-003575784817 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 19:59:00.208879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3198a63f6d1a4cdd88d76189658e79c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '025035b3b0b348d7acddfe456dd6a109', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:00.216235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c3a268cc-288c-46a7-b6f6-e072610f9cd1 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 200 len: 1326 microversion: 2.1 time: 0.093987 Jul 01 19:59:00.216804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 378/748] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:00 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 1326 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:01.063415 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:01.064708 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:01.072171 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:01.072628 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:01.073569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:01.074210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:01.221228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:01.229181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:01.230749 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:01.231911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a3ad9f79-e38a-4bc4-b288-c643c045a476 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.172258 Jul 01 19:59:01.232463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 371/749] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:01 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:01.233282 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:01.233943 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:01.240982 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:01.241422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:01.242409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:01.242839 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:01.257393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] HTTP exception thrown: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Request method failure captured: Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 HTTP/1.1 Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CawOXuTNECAaZQHFOZy77H09Gh-584JLX96sFbun7bwW0iQcLx85NQ70iVBr3swOqs2b4yhOF36a8e_Dd26qq41bHo3xurYljxMjT8DGjhlU9Cfa4J78k9DTxNPmbDSgq23TBBXdAjfGWAAIp3ohSyA932NFi-lIIuWa6pTVdj5ow Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:01.259121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3198a63f6d1a4cdd88d76189658e79c0 Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:01.260750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '81be27a4-51b0-4fa6-8e9b-003575784817'} Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:01.261554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:01.262858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:01.265104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Returning 404 to user: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:01.265104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-15d4fe73-946a-4c65-82da-59ef9bac977a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 404 len: 111 microversion: 2.1 time: 0.030978 Jul 01 19:59:01.265104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 379/750] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:01 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:59:01.269906 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-38327163-e40b-4756-b2b2-fbedda936f2a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '.version_select at 0x7fa0075e4040>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:01.287228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-38327163-e40b-4756-b2b2-fbedda936f2a tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-99438602" status: 202 len: 0 microversion: 2.1 time: 0.021713 Jul 01 19:59:01.287781 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 372/751] 10.222.0.66 () {58 vars in 1214 bytes} [Fri Jul 1 19:59:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-99438602 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:59:02.249557 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:02.250306 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:02.258346 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:02.258795 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:02.259565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:02.259999 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:02.487078 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:02.497390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:02.499166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:02.500531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-cc3da585-e912-42ca-9475-614d5dc770a9 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.255305 Jul 01 19:59:02.501605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 380/752] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:02 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:03.525818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:03.527148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:03.536718 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:03.537483 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:03.539028 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:03.539978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:03.699732 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:03.708246 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:03.709797 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:03.710959 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9ba555c9-0084-4320-acca-778cf1b33242 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.192198 Jul 01 19:59:03.711518 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 373/753] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:03 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:04.185156 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:04.185693 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:04.192639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.193077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.193855 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.194291 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.208438 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] HTTP exception thrown: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Request method failure captured: Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 HTTP/1.1 Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CawOXuTNECAaZQHFOZy77H09Gh-584JLX96sFbun7bwW0iQcLx85NQ70iVBr3swOqs2b4yhOF36a8e_Dd26qq41bHo3xurYljxMjT8DGjhlU9Cfa4J78k9DTxNPmbDSgq23TBBXdAjfGWAAIp3ohSyA932NFi-lIIuWa6pTVdj5ow Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:04.209984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3198a63f6d1a4cdd88d76189658e79c0 Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.211527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '81be27a4-51b0-4fa6-8e9b-003575784817'} Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:04.212403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.214020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.215490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Returning 404 to user: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:04.215490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-08eee917-aeb3-4af1-a5a7-51f8746bf73b tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 404 len: 111 microversion: 2.1 time: 0.029989 Jul 01 19:59:04.215490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 381/754] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:59:04 2022] DELETE /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:04.219650 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:04.220260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: 81be27a4-51b0-4fa6-8e9b-003575784817] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:04.226680 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.227120 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.227870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.228301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.241347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] HTTP exception thrown: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Request method failure captured: Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 HTTP/1.1 Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CawOXuTNECAaZQHFOZy77H09Gh-584JLX96sFbun7bwW0iQcLx85NQ70iVBr3swOqs2b4yhOF36a8e_Dd26qq41bHo3xurYljxMjT8DGjhlU9Cfa4J78k9DTxNPmbDSgq23TBBXdAjfGWAAIp3ohSyA932NFi-lIIuWa6pTVdj5ow Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:59:04.242982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3198a63f6d1a4cdd88d76189658e79c0 Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.244481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '81be27a4-51b0-4fa6-8e9b-003575784817'} Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:04.245362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. Jul 01 19:59:04.246838 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:04.248113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Returning 404 to user: Instance 81be27a4-51b0-4fa6-8e9b-003575784817 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:04.248113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-24d2f0b2-2b41-4904-8dc2-a8fb4a32e4cb tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817" status: 404 len: 111 microversion: 2.1 time: 0.028458 Jul 01 19:59:04.248113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 374/755] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:04 2022] GET /compute/v2.1/servers/81be27a4-51b0-4fa6-8e9b-003575784817 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:59:04.639289 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-9ee4e4c2-a978-4eaf-929e-a5e3cd0bb60a req-4fe479fc-d16a-4d13-96bd-c0c68bac1b72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "name": "network-vif-plugged", "status": "completed", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:04.648054 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9ee4e4c2-a978-4eaf-929e-a5e3cd0bb60a req-4fe479fc-d16a-4d13-96bd-c0c68bac1b72 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.648504 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9ee4e4c2-a978-4eaf-929e-a5e3cd0bb60a req-4fe479fc-d16a-4d13-96bd-c0c68bac1b72 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.663044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-9ee4e4c2-a978-4eaf-929e-a5e3cd0bb60a req-4fe479fc-d16a-4d13-96bd-c0c68bac1b72 service nova] Creating event network-vif-plugged:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:59:04.667946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-9ee4e4c2-a978-4eaf-929e-a5e3cd0bb60a req-4fe479fc-d16a-4d13-96bd-c0c68bac1b72 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Jul 01 19:59:04.668722 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 382/756] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:04.729227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:04.730032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:04.739061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.739651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.740424 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:04.740862 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:04.916700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:04.924720 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:04.926934 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:04.928109 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a0ca2b19-6d03-434a-97f4-385e73d1897a tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.202776 Jul 01 19:59:04.928666 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 375/757] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:04 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:05.382100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:05.382683 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:05.388782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:05.389232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:05.390019 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:05.390460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:05.393107 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:05.405511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] HTTP exception thrown: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Request method failure captured: Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e HTTP/1.1 Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CawOXuTNECAaZQHFOZy77H09Gh-584JLX96sFbun7bwW0iQcLx85NQ70iVBr3swOqs2b4yhOF36a8e_Dd26qq41bHo3xurYljxMjT8DGjhlU9Cfa4J78k9DTxNPmbDSgq23TBBXdAjfGWAAIp3ohSyA932NFi-lIIuWa6pTVdj5ow Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:05.407216 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3198a63f6d1a4cdd88d76189658e79c0 Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.408749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'c1a80874-00ef-4d4b-8ef0-7a604ed7458e'} Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:05.409702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.411215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.412960 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Returning 404 to user: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:05.412960 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f8912600-9f14-4c5e-bf89-61aa2fee9b63 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 404 len: 111 microversion: 2.1 time: 0.031969 Jul 01 19:59:05.412960 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 383/758] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:59:05 2022] DELETE /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:05.417379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:05.418031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] [instance: c1a80874-00ef-4d4b-8ef0-7a604ed7458e] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:05.424150 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:05.424540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:05.425836 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:05.426444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:05.439349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] HTTP exception thrown: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Request method failure captured: Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e HTTP/1.1 Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CawOXuTNECAaZQHFOZy77H09Gh-584JLX96sFbun7bwW0iQcLx85NQ70iVBr3swOqs2b4yhOF36a8e_Dd26qq41bHo3xurYljxMjT8DGjhlU9Cfa4J78k9DTxNPmbDSgq23TBBXdAjfGWAAIp3ohSyA932NFi-lIIuWa6pTVdj5ow Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:59:05.441482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/025035b3b0b348d7acddfe456dd6a109"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 025035b3b0b348d7acddfe456dd6a109 Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeTestJSON-735892358 Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3198a63f6d1a4cdd88d76189658e79c0 Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeTestJSON-735892358-project Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.443066 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'c1a80874-00ef-4d4b-8ef0-7a604ed7458e'} Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:05.447156 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. Jul 01 19:59:05.449193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:05.450502 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] Returning 404 to user: Instance c1a80874-00ef-4d4b-8ef0-7a604ed7458e could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:05.450502 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-818409d1-f799-439f-9325-d345233c2525 tempest-AttachVolumeTestJSON-735892358 tempest-AttachVolumeTestJSON-735892358-project] 10.222.0.66 "GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e" status: 404 len: 111 microversion: 2.1 time: 0.029345 Jul 01 19:59:05.450502 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 376/759] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:05 2022] GET /compute/v2.1/servers/c1a80874-00ef-4d4b-8ef0-7a604ed7458e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:05.946513 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:05.947449 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:05.954367 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:05.954817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:05.955582 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:05.956017 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:06.088069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:06.096221 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:06.097969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:06.099131 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b0cda4a6-7866-4cb2-84c2-bfcf7c518703 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.156847 Jul 01 19:59:06.099899 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 384/760] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:05 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:07.117050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:07.118939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:07.129886 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:07.130569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:07.132080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:07.132678 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:07.288439 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:07.297080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:07.298607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:07.299765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3edbf0f4-fd29-417d-9e91-9f06ecf9d504 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1727 microversion: 2.20 time: 0.187411 Jul 01 19:59:07.301151 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 377/761] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:07 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:08.318650 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:08.319258 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:08.326333 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:08.327077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:08.328404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:08.329183 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:08.543186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:08.561961 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:08.563729 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:08.565405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0b64bce8-75b9-491a-93fe-93467d797286 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1714 microversion: 2.20 time: 0.251431 Jul 01 19:59:08.582261 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 385/762] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:08 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1714 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:10.245565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f33b47e5-e2c3-44e7-a567-3122453ad459 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Action: 'create', calling method: .version_select at 0x7fa0075c5c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-27203867"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:10.534654 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f33b47e5-e2c3-44e7-a567-3122453ad459 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.402267 Jul 01 19:59:10.535279 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 378/763] 10.222.0.66 () {60 vars in 1154 bytes} [Fri Jul 1 19:59:10 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 404 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 01 19:59:10.550539 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4fd985df-8851-4bb5-9f80-5a541219d81a tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0076b6280>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:10.602682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4fd985df-8851-4bb5-9f80-5a541219d81a tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 200 len: 343 microversion: 2.1 time: 0.060228 Jul 01 19:59:10.603502 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 386/764] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 19:59:10 2022] GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 343 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:11.615795 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-747ab727-653e-4d10-98ae-25aaae782262 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007435430>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:11.662431 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-747ab727-653e-4d10-98ae-25aaae782262 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 200 len: 344 microversion: 2.1 time: 0.051041 Jul 01 19:59:11.663209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 379/765] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 19:59:11 2022] GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:11.674433 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ab3f13fc-2532-43b2-a6ce-212601b1cef1 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Action: 'create', calling method: .version_select at 0x7fa0074401f0>, body: {"snapshot": {"volume_id": "d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1712245998"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:11.825773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ab3f13fc-2532-43b2-a6ce-212601b1cef1 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.155483 Jul 01 19:59:11.826419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 387/766] 10.222.0.66 () {60 vars in 1161 bytes} [Fri Jul 1 19:59:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:59:11.836973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-df6820bf-c339-4308-a2d4-6b8050c976dc tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007624ee0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:11.868219 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-df6820bf-c339-4308-a2d4-6b8050c976dc tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 200 len: 287 microversion: 2.1 time: 0.034905 Jul 01 19:59:11.869054 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 380/767] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:11 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:11.879227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-41f60955-57ae-435a-91da-4128bf98de21 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0075673a0>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:11.908364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-41f60955-57ae-435a-91da-4128bf98de21 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033462 Jul 01 19:59:11.908939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 388/768] 10.222.0.66 () {58 vars in 1139 bytes} [Fri Jul 1 19:59:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:11.918919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e0682b93-76fc-4013-a13f-e86c829ec0f3 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0074bd0d0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:11.948903 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e0682b93-76fc-4013-a13f-e86c829ec0f3 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 200 len: 287 microversion: 2.1 time: 0.033680 Jul 01 19:59:11.949481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 381/769] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:11 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:12.961462 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-154e0ee3-062b-45b7-9b8b-d618546bf101 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa00770f790>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:12.993309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-154e0ee3-062b-45b7-9b8b-d618546bf101 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 200 len: 287 microversion: 2.1 time: 0.036697 Jul 01 19:59:12.994041 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 389/770] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:12 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:14.005967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-dc3c66e7-98e1-4885-8314-cca4c87ac404 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0076e04c0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:14.034560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-dc3c66e7-98e1-4885-8314-cca4c87ac404 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 200 len: 287 microversion: 2.1 time: 0.033400 Jul 01 19:59:14.035971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 382/771] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:13 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:59:15.047028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6c8eea7a-6780-408d-b466-f9a351552223 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007442940>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:15.075687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6c8eea7a-6780-408d-b466-f9a351552223 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 200 len: 288 microversion: 2.1 time: 0.033062 Jul 01 19:59:15.076232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 390/772] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:15 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:15.087306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c98147fb-0d2d-4452-8937-d1031c653473 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0075c5790>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:15.129988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:15.130483 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:15.137605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:15.138106 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:15.138883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:15.139393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:15.145270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c98147fb-0d2d-4452-8937-d1031c653473 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 202 len: 0 microversion: 2.1 time: 0.061629 Jul 01 19:59:15.146245 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 383/773] 10.222.0.66 () {58 vars in 1253 bytes} [Fri Jul 1 19:59:15 2022] DELETE /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:59:15.154048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e7b6dae6-aaa7-4182-a011-f3ae9e620df0 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0076e0ca0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:15.165393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-17fa2cbf-f4e3-4a32-aea6-a589582b482e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/ips" status: 200 len: 150 microversion: 2.1 time: 0.039431 Jul 01 19:59:15.166062 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 391/774] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 19:59:15 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:59:15.184663 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e7b6dae6-aaa7-4182-a011-f3ae9e620df0 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 200 len: 287 microversion: 2.1 time: 0.034110 Jul 01 19:59:15.185226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 384/775] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:15 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:59:16.195568 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ca6e784b-5a8a-4a05-b231-259f422eaf8d tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007441ee0>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:16.220849 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-ca6e784b-5a8a-4a05-b231-259f422eaf8d tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] HTTP exception thrown: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ca6e784b-5a8a-4a05-b231-259f422eaf8d tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Request method failure captured: Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 HTTP/1.1 Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1IO0BmUCLKpNfFfnLZnbdm5Cxj-LT7BSiEcL_24oF3xqWQikPmxnbUuE2NnRjF-PvHRqNBQFPg6-oXzTbmhJYKwkWmM61plmFXXlGh9Wzlj4Wse6_FoJ7CS3tgnRmVK2BhSaSVICDGBaznX0_8dvhiqYX_EepXvIzfDScUyfqxLOXY Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:16.223700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06638794c7444edcbc9497db49af27e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06638794c7444edcbc9497db49af27e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 9f5260158d0c4ed2a43d1a73817bf69c Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '0f3cfdc2-b231-425a-a3a5-6969b2810b92'} Jul 01 19:59:16.226072 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. (HTTP 404) (Request-ID: req-8c36dafa-eddb-41f0-885d-21d27b205bca) Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.227764 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:59:16.230242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 01 19:59:16.232413 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ca6e784b-5a8a-4a05-b231-259f422eaf8d tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Returning 404 to user: Snapshot 0f3cfdc2-b231-425a-a3a5-6969b2810b92 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:16.234601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ca6e784b-5a8a-4a05-b231-259f422eaf8d tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92" status: 404 len: 111 microversion: 2.1 time: 0.033436 Jul 01 19:59:16.236018 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 392/776] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:16 2022] GET /compute/v2.1/os-snapshots/0f3cfdc2-b231-425a-a3a5-6969b2810b92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:16.236149 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5fa3a789-ff1d-495b-956d-dcd340334e2f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007435670>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:16.297540 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5fa3a789-ff1d-495b-956d-dcd340334e2f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 202 len: 0 microversion: 2.1 time: 0.065869 Jul 01 19:59:16.298126 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 385/777] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 19:59:16 2022] DELETE /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:59:16.307096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ce5680ab-ec41-4643-b01a-663dfef0338c tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007440160>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:16.354863 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ce5680ab-ec41-4643-b01a-663dfef0338c tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 200 len: 343 microversion: 2.1 time: 0.051478 Jul 01 19:59:16.355431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 393/778] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 19:59:16 2022] GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 343 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:16.533790 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:16.534833 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:16.537485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:16.543368 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:16.543808 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:16.544557 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:16.544984 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:16.547912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=95 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:16.783668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b515debb-dcf2-4bd8-9d75-056b5f6847d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253819 Jul 01 19:59:16.784290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 386/779] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 19:59:16 2022] POST /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:17.367721 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7e30171d-631a-47de-90ab-802db930da3f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007441f70>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:17.394680 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-7e30171d-631a-47de-90ab-802db930da3f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] HTTP exception thrown: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7e30171d-631a-47de-90ab-802db930da3f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Request method failure captured: Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 HTTP/1.1 Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1IO0BmUCLKpNfFfnLZnbdm5Cxj-LT7BSiEcL_24oF3xqWQikPmxnbUuE2NnRjF-PvHRqNBQFPg6-oXzTbmhJYKwkWmM61plmFXXlGh9Wzlj4Wse6_FoJ7CS3tgnRmVK2BhSaSVICDGBaznX0_8dvhiqYX_EepXvIzfDScUyfqxLOXY Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:17.397446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06638794c7444edcbc9497db49af27e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06638794c7444edcbc9497db49af27e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 9f5260158d0c4ed2a43d1a73817bf69c Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'd5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0'} Jul 01 19:59:17.399015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. (HTTP 404) (Request-ID: req-424cdd7c-1c8b-42d5-b512-099bd53a7180) Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.399949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:59:17.401334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:59:17.402700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7e30171d-631a-47de-90ab-802db930da3f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Returning 404 to user: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7e30171d-631a-47de-90ab-802db930da3f tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 404 len: 109 microversion: 2.1 time: 0.035436 Jul 01 19:59:17.404180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 394/780] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 19:59:17 2022] GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:17.414557 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-334004d2-273a-4baf-8846-a27c09e7aaaf tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa0074600d0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:17.442993 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-334004d2-273a-4baf-8846-a27c09e7aaaf tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] HTTP exception thrown: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-334004d2-273a-4baf-8846-a27c09e7aaaf tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Request method failure captured: Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: DELETE /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 HTTP/1.1 Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1IO0BmUCLKpNfFfnLZnbdm5Cxj-LT7BSiEcL_24oF3xqWQikPmxnbUuE2NnRjF-PvHRqNBQFPg6-oXzTbmhJYKwkWmM61plmFXXlGh9Wzlj4Wse6_FoJ7CS3tgnRmVK2BhSaSVICDGBaznX0_8dvhiqYX_EepXvIzfDScUyfqxLOXY Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:59:17.445106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06638794c7444edcbc9497db49af27e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06638794c7444edcbc9497db49af27e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 9f5260158d0c4ed2a43d1a73817bf69c Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'd5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0'} Jul 01 19:59:17.446713 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. (HTTP 404) (Request-ID: req-6d0f8b58-776f-4c76-92d1-9d4f9875a95f) Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.447588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 01 19:59:17.448957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 01 19:59:17.450336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-334004d2-273a-4baf-8846-a27c09e7aaaf tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Returning 404 to user: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-334004d2-273a-4baf-8846-a27c09e7aaaf tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 404 len: 109 microversion: 2.1 time: 0.037448 Jul 01 19:59:17.451691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 387/781] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 19:59:17 2022] DELETE /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:17.454739 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2514b390-b5ff-4693-be4b-9b84cc361b44 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Calling method '.version_select at 0x7fa007488670>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:17.486190 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-2514b390-b5ff-4693-be4b-9b84cc361b44 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] HTTP exception thrown: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2514b390-b5ff-4693-be4b-9b84cc361b44 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Request method failure captured: Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 HTTP/1.1 Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1IO0BmUCLKpNfFfnLZnbdm5Cxj-LT7BSiEcL_24oF3xqWQikPmxnbUuE2NnRjF-PvHRqNBQFPg6-oXzTbmhJYKwkWmM61plmFXXlGh9Wzlj4Wse6_FoJ7CS3tgnRmVK2BhSaSVICDGBaznX0_8dvhiqYX_EepXvIzfDScUyfqxLOXY Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:17.488144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_06638794c7444edcbc9497db49af27e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/06638794c7444edcbc9497db49af27e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/06638794c7444edcbc9497db49af27e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 06638794c7444edcbc9497db49af27e2 Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1917902661 Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 9f5260158d0c4ed2a43d1a73817bf69c Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1917902661-project Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'd5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0'} Jul 01 19:59:17.490801 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. (HTTP 404) (Request-ID: req-b35ec388-1370-406a-8574-43c5256460e9) Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.491720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 19:59:17.493050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 19:59:17.494390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2514b390-b5ff-4693-be4b-9b84cc361b44 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] Returning 404 to user: Volume d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2514b390-b5ff-4693-be4b-9b84cc361b44 tempest-VolumesSnapshotsTestJSON-1917902661 tempest-VolumesSnapshotsTestJSON-1917902661-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0" status: 404 len: 109 microversion: 2.1 time: 0.039226 Jul 01 19:59:17.495688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 395/782] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 19:59:17 2022] GET /compute/v2.1/os-volumes/d5b4e3e5-5db1-4cd2-a3d6-bd5eeccd7bf0 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 19:59:18.781081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:18.781821 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:18.784301 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-7f8b5b3d-b1fc-4975-91fa-32ea7d08f5e7 req-b6558756-1d1b-41d9-8ade-7382839a02ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:18.789410 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=43 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:18.790573 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:18.791157 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:18.792169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:18.792922 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:18.803445 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-7f8b5b3d-b1fc-4975-91fa-32ea7d08f5e7 req-b6558756-1d1b-41d9-8ade-7382839a02ac service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:18.804173 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-7f8b5b3d-b1fc-4975-91fa-32ea7d08f5e7 req-b6558756-1d1b-41d9-8ade-7382839a02ac service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:18.818104 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-7f8b5b3d-b1fc-4975-91fa-32ea7d08f5e7 req-b6558756-1d1b-41d9-8ade-7382839a02ac service nova] Creating event network-changed:1703035c-ecba-43aa-ab94-ee8dc5dedbe4 for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 on hv-cinder-84460 Jul 01 19:59:18.823249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-7f8b5b3d-b1fc-4975-91fa-32ea7d08f5e7 req-b6558756-1d1b-41d9-8ade-7382839a02ac service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043004 Jul 01 19:59:18.824385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 396/783] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 19:59:18.827784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:59:18.975003 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-330f19f4-bf03-4136-998a-cd12d5e742bc tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "DELETE /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 204 len: 0 microversion: 2.1 time: 0.195173 Jul 01 19:59:18.976325 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 388/784] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 19:59:18 2022] DELETE /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 19:59:18.985853 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:18.986889 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:19.000268 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:19.000912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:19.001922 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:19.002546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:19.178667 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:19.190102 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b4c5aef0-26aa-42a1-a15d-feba3501cf9c tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.209146 Jul 01 19:59:19.192239 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 397/785] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:18 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:20.210469 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:20.211381 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:20.218250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:20.218823 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:20.219690 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:20.220229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:20.454924 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:20.465096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a927673a-d8d7-4eb3-a951-c3ea991a77d4 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1569 microversion: 2.1 time: 0.260196 Jul 01 19:59:20.465688 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 389/786] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:20 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:21.106064 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-689aa5b0-71eb-4249-b890-b82ac92f7ef0 req-fda262a7-f7e0-40e8-82bd-1a2da54e8806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee927ae4-fe7f-411f-be38-1d732b6ba6e3", "name": "network-vif-deleted", "tag": "1703035c-ecba-43aa-ab94-ee8dc5dedbe4"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:21.117013 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-689aa5b0-71eb-4249-b890-b82ac92f7ef0 req-fda262a7-f7e0-40e8-82bd-1a2da54e8806 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:21.117454 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-689aa5b0-71eb-4249-b890-b82ac92f7ef0 req-fda262a7-f7e0-40e8-82bd-1a2da54e8806 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:21.132453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-689aa5b0-71eb-4249-b890-b82ac92f7ef0 req-fda262a7-f7e0-40e8-82bd-1a2da54e8806 service nova] Creating event network-vif-deleted:1703035c-ecba-43aa-ab94-ee8dc5dedbe4 for instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 on hv-cinder-84460 Jul 01 19:59:21.138514 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-689aa5b0-71eb-4249-b890-b82ac92f7ef0 req-fda262a7-f7e0-40e8-82bd-1a2da54e8806 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036157 Jul 01 19:59:21.142885 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 398/787] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:21.484918 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:21.486361 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:21.498579 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:21.499459 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:21.500601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:21.501209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:21.579025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c815ea64d44a48d89a2f5ff10f3f9ee8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '669587fe364c4741b489449451f2294c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:21.587249 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fd2e604c-5dd2-4d25-90fc-28980f6ecf16 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 200 len: 1219 microversion: 2.1 time: 0.107606 Jul 01 19:59:21.587813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 390/788] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:21 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 1219 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:22.605881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:22.606605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] [instance: ee927ae4-fe7f-411f-be38-1d732b6ba6e3] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:22.612929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:22.614015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:22.614816 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:22.615249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:22.630614 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] HTTP exception thrown: Instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 could not be found. Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Request method failure captured: Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 HTTP/1.1 Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1DUL748eDKowjO_KMUVg2i8xPhxwR0RHMlN3AeQBYy8qwxUH57qyOzLjZjfwF1C7QybNkhEAd7v5ydR2b-QIzi8d5Qb5VPisVA_RVPKw6xbbgL6E9UabdnGAydBVMChdwqMYVklAsyfna4ABjEKlynCyPaQVxGW94FYaCUVtRJCGvg Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 669587fe364c4741b489449451f2294c Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-TestShelveInstance-104514394 Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:22.631701 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_669587fe364c4741b489449451f2294c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/669587fe364c4741b489449451f2294c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/669587fe364c4741b489449451f2294c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/669587fe364c4741b489449451f2294c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-TestShelveInstance-104514394 Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 669587fe364c4741b489449451f2294c Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-TestShelveInstance-104514394 Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-TestShelveInstance-104514394-project Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: c815ea64d44a48d89a2f5ff10f3f9ee8 Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-TestShelveInstance-104514394-project Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 could not be found. Jul 01 19:59:22.633264 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'ee927ae4-fe7f-411f-be38-1d732b6ba6e3'} Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 could not be found. Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:22.634158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 could not be found. Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 could not be found. Jul 01 19:59:22.635573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:22.636866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Returning 404 to user: Instance ee927ae4-fe7f-411f-be38-1d732b6ba6e3 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:22.636866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3f99ae33-d848-4e90-8931-9073f0672696 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3" status: 404 len: 111 microversion: 2.1 time: 0.031933 Jul 01 19:59:22.636866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 399/789] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:22 2022] GET /compute/v2.1/servers/ee927ae4-fe7f-411f-be38-1d732b6ba6e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 19:59:22.807928 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-363f8710-f712-44c4-96e0-0dcfaa99c387 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] Calling method '.version_select at 0x7fa00745b1f0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:22.829172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-363f8710-f712-44c4-96e0-0dcfaa99c387 tempest-TestShelveInstance-104514394 tempest-TestShelveInstance-104514394-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-370955949" status: 202 len: 0 microversion: 2.1 time: 0.024859 Jul 01 19:59:22.829958 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 391/790] 10.222.0.66 () {58 vars in 1250 bytes} [Fri Jul 1 19:59:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-370955949 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 19:59:23.455836 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-61985817-f556-4a04-af9f-4fa3d18663e9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: .version_select at 0x7fa007440f70>, body: {"keypair": {"name": "tempest-keypair-543948058", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH0XOTNqlragocOjpC5qiYKvAx2DUEo8+NtyCS7nCGQwyV8j+biQ/n+Y0uwzGmaz3cJZD0Z3f5afV+8nO+PSJPP5U7JgsVYUdM2LoyQxrnOL1tOCJXmWnXD27R7aUtbHzg=="}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:23.470596 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-61985817-f556-4a04-af9f-4fa3d18663e9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:59:23.475468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-61985817-f556-4a04-af9f-4fa3d18663e9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:59:23.498788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-61985817-f556-4a04-af9f-4fa3d18663e9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046891 Jul 01 19:59:23.499415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 400/791] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 19:59:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:25.316074 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-557123556", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd301699-ca40-48e9-9559-67a73cd4bb19"}], "security_groups": [{"name": "tempest-securitygroup--1416401425"}], "key_name": "tempest-keypair-543948058", "user_data": "}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:25.474388 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] validate_networks() for [('bd301699-ca40-48e9-9559-67a73cd4bb19', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 19:59:26.185390 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 19:59:26.185845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 19:59:26.186914 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 19:59:26.187332 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 19:59:26.187932 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 19:59:26.204957 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:26.205417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:26.208194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:26.210173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:26.232763 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 19:59:26.238278 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 19:59:26.255725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 19:59:26.259100 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 19:59:26.319617 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-33c359cd-9138-4e66-b69e-b9187817ba41 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.008386 Jul 01 19:59:26.321042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 392/792] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 19:59:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 19:59:26.331406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-15394588-fe51-4310-a501-0044da2e39a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:26.333112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-15394588-fe51-4310-a501-0044da2e39a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:26.453261 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-15394588-fe51-4310-a501-0044da2e39a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:26.465753 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-15394588-fe51-4310-a501-0044da2e39a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1240 microversion: 2.1 time: 0.138638 Jul 01 19:59:26.466336 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 401/793] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:26 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1240 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:27.493288 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:27.493952 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:27.510485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:27.511209 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:27.512344 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:27.513022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:27.612248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:27.623714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e05e6e1c-f309-4221-8205-89339ae002f6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1310 microversion: 2.1 time: 0.140690 Jul 01 19:59:27.624831 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 393/794] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:27 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1310 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:28.643243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:28.643946 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:28.657687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:28.658378 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:28.659229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:28.659666 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:29.241065 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:29.250342 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7be1bfbc-6af0-444b-8d4c-091ee32f2778 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.611004 Jul 01 19:59:29.251204 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 402/795] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:28 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:30.273206 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:30.273929 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:30.289571 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-f239ab01-aa53-4725-a3e4-782bdf8c9939 req-a3ddeb5d-7538-4517-9baa-2e8dc46183ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19da010-1763-4196-8876-e78433c1e0cb", "tag": "98b20cd5-6624-4dbe-9595-c5388d391222"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:30.325161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-f239ab01-aa53-4725-a3e4-782bdf8c9939 req-a3ddeb5d-7538-4517-9baa-2e8dc46183ea service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:30.325776 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-f239ab01-aa53-4725-a3e4-782bdf8c9939 req-a3ddeb5d-7538-4517-9baa-2e8dc46183ea service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:30.328537 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:30.328991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:30.330009 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:30.330459 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:30.370624 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-f239ab01-aa53-4725-a3e4-782bdf8c9939 req-a3ddeb5d-7538-4517-9baa-2e8dc46183ea service nova] Creating event network-changed:98b20cd5-6624-4dbe-9595-c5388d391222 for instance c19da010-1763-4196-8876-e78433c1e0cb on hv-cinder-84460 Jul 01 19:59:30.382078 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-f239ab01-aa53-4725-a3e4-782bdf8c9939 req-a3ddeb5d-7538-4517-9baa-2e8dc46183ea service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096870 Jul 01 19:59:30.385152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 403/796] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:30.704625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:30.713687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d765f54b-4cd0-4420-b790-c2c53cdde5ce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.447905 Jul 01 19:59:30.723603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 394/797] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:30 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:31.732048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:31.732757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:31.747696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:31.747696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:31.747696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:31.747696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:31.901854 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:31.913325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bd10c175-3a20-4947-9fda-d91bcc360552 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.181846 Jul 01 19:59:31.913325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 404/798] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:31 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 19:59:32.927988 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:32.928753 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:32.935937 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:32.936483 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:32.937282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:32.937750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:33.081269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:33.089549 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-791a1925-0483-44db-a6a3-2f6e2760c587 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.166141 Jul 01 19:59:33.090195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 395/799] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:32 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:34.107040 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:34.107669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:34.114094 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:34.114553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:34.115896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:34.116390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:34.252687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:34.261343 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9fe99922-3cb8-4ea0-b5e5-f235211f2e5f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.158160 Jul 01 19:59:34.262070 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 405/800] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:34 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:35.281278 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:35.282061 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:35.289725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:35.290181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:35.291650 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:35.292246 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:35.427426 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:35.436252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f1a5e4fb-e382-4319-b967-c304691ade97 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.159967 Jul 01 19:59:35.436828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 396/801] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:35 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:36.453419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:36.454071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:36.458365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:36.462769 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:36.463222 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:36.463991 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:36.464427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:36.468969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=50 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:36.608546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:36.616682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a5e31f91-1afa-45c9-8b54-f9ff76080239 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.167229 Jul 01 19:59:36.617249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 406/802] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:36 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:36.867213 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-952ea46f-4528-45fa-a669-214846664937 req-0f375ece-af39-4b51-9470-eef24f7e68ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19da010-1763-4196-8876-e78433c1e0cb", "name": "network-vif-plugged", "status": "completed", "tag": "98b20cd5-6624-4dbe-9595-c5388d391222"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:36.873441 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:36.874445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=6 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:36.884345 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-952ea46f-4528-45fa-a669-214846664937 req-0f375ece-af39-4b51-9470-eef24f7e68ad service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:36.884830 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-952ea46f-4528-45fa-a669-214846664937 req-0f375ece-af39-4b51-9470-eef24f7e68ad service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:36.897764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-952ea46f-4528-45fa-a669-214846664937 req-0f375ece-af39-4b51-9470-eef24f7e68ad service nova] Creating event network-vif-plugged:98b20cd5-6624-4dbe-9595-c5388d391222 for instance c19da010-1763-4196-8876-e78433c1e0cb on hv-cinder-84460 Jul 01 19:59:36.902886 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-952ea46f-4528-45fa-a669-214846664937 req-0f375ece-af39-4b51-9470-eef24f7e68ad service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040092 Jul 01 19:59:36.903531 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 397/803] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:37.634245 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:37.635455 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:37.642556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:37.643490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:37.645179 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:37.645811 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:37.854295 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:37.861827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0f908468-2a60-4f4d-8392-1a86cab7e757 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1366 microversion: 2.1 time: 0.232065 Jul 01 19:59:37.862395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 407/804] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:37 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:38.881451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:38.882192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:38.888918 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:38.889362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:38.890225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:38.891091 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:39.113767 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:39.122528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-62641182-b06f-4965-864b-9bafdb1300b5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1556 microversion: 2.1 time: 0.245848 Jul 01 19:59:39.123172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 398/805] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 19:59:38 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1556 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:39.140135 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:39.140682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:39.148538 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:39.148993 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:39.150055 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:39.150593 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:39.242434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9ed93231-42ca-47a0-b390-029d41c50fdc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105998 Jul 01 19:59:39.243034 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 408/806] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 19:59:39 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:40.490927 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-4e5d0c6f-7f02-411c-8800-f083e53567dc req-5df9c602-2127-4c74-91a4-191f8b915ff3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c19da010-1763-4196-8876-e78433c1e0cb", "tag": "98b20cd5-6624-4dbe-9595-c5388d391222"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:40.499456 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4e5d0c6f-7f02-411c-8800-f083e53567dc req-5df9c602-2127-4c74-91a4-191f8b915ff3 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:40.500104 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4e5d0c6f-7f02-411c-8800-f083e53567dc req-5df9c602-2127-4c74-91a4-191f8b915ff3 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:40.512155 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-4e5d0c6f-7f02-411c-8800-f083e53567dc req-5df9c602-2127-4c74-91a4-191f8b915ff3 service nova] Creating event network-changed:98b20cd5-6624-4dbe-9595-c5388d391222 for instance c19da010-1763-4196-8876-e78433c1e0cb on hv-cinder-84460 Jul 01 19:59:40.517024 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-4e5d0c6f-7f02-411c-8800-f083e53567dc req-5df9c602-2127-4c74-91a4-191f8b915ff3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030400 Jul 01 19:59:40.517691 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 399/807] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:41.459384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:41.460321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:41.466398 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:41.466846 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:41.467611 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:41.468044 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:41.497476 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4cf58cb7-bccc-490b-a272-f981a4820bd4 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042526 Jul 01 19:59:41.498089 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 409/808] 10.222.0.66 () {60 vars in 1342 bytes} [Fri Jul 1 19:59:41 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 19:59:41.563683 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:41.564464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:41.571792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:41.572258 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:41.573032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:41.573467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:41.600079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 19:59:41.677982 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-293f6700-0fac-48bc-97e8-5addba79007f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 204 len: 0 microversion: 2.20 time: 0.119452 Jul 01 19:59:41.678589 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 400/809] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 1 19:59:41 2022] DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 19:59:41.687192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:41.687782 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:41.694225 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:41.694663 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:41.695419 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:41.695849 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:41.824391 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:41.832817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:41.834347 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:41.835510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ab8ef448-54b2-419a-b707-7484895e020f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.152286 Jul 01 19:59:41.836065 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 410/810] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:41 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 01 19:59:42.853813 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:42.854516 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:42.860996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:42.861438 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:42.862726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:42.863340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:42.998851 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:43.006870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:43.008378 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:43.009538 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-95a12bd3-1173-4473-b89a-8e3a36be61ec tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1720 microversion: 2.20 time: 0.160206 Jul 01 19:59:43.010120 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 401/811] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:42 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:44.028407 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:44.029026 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:44.036105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:44.036550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:44.037318 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:44.037804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:44.146025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:44.154512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:44.156198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3307be3159654f55be46e75c82584bf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8e38ec3f92a47fe98829eb3d289cdb4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 19:59:44.157490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c9e0c6da-5950-41fc-a562-2138d90f5c48 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 200 len: 1652 microversion: 2.20 time: 0.133230 Jul 01 19:59:44.158210 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 411/812] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:44 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 1652 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 01 19:59:44.353818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-4154cc94-b103-4fd8-a814-258eb5679033 req-86ca3063-bb19-44af-936d-241ad620a3be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aebdcfdb-f355-4d88-94a2-ef1d4191f28d", "name": "network-vif-deleted", "tag": "7bcf54c4-3b63-4285-981e-25adbeaaf278"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 19:59:44.365346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4154cc94-b103-4fd8-a814-258eb5679033 req-86ca3063-bb19-44af-936d-241ad620a3be service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:44.366319 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4154cc94-b103-4fd8-a814-258eb5679033 req-86ca3063-bb19-44af-936d-241ad620a3be service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:44.369533 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:44.382241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-4154cc94-b103-4fd8-a814-258eb5679033 req-86ca3063-bb19-44af-936d-241ad620a3be service nova] Creating event network-vif-deleted:7bcf54c4-3b63-4285-981e-25adbeaaf278 for instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d on hv-cinder-84460 Jul 01 19:59:44.388255 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-4154cc94-b103-4fd8-a814-258eb5679033 req-86ca3063-bb19-44af-936d-241ad620a3be service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038160 Jul 01 19:59:44.389050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 402/813] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 19:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 19:59:45.176696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:45.177309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:45.183903 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:45.184320 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:45.185066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:45.185502 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:45.200405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] HTTP exception thrown: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Request method failure captured: Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d HTTP/1.1 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CUTtCUlOrvsuEbpRVe7KfqcssFKv9MhQLSuJimsccSd_BZZP-V3BZizkFIK3VloxX2R9PUE4oMzLTWewZHLfcN8tU7XHXzpwKJcrFXkbWbNdKeFHghtxXDsgFSWhLET4MhJgpjUrndw5J4KNCtiuZ60qgpMlaKHdSXXbfXML376rc Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:45.201974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3307be3159654f55be46e75c82584bf0 Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:45.203877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'aebdcfdb-f355-4d88-94a2-ef1d4191f28d'} Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:45.204956 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:45.207334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:45.209377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Returning 404 to user: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:45.209377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bece78a9-cb75-45af-929b-fad9c4561c60 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 404 len: 111 microversion: 2.20 time: 0.030929 Jul 01 19:59:45.209377 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 412/814] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:45 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:59:45.213676 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-177d8f85-aa4c-4029-9037-e437f96b112d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '.version_select at 0x7fa0076244c0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:45.233165 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-177d8f85-aa4c-4029-9037-e437f96b112d tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-609899576" status: 204 len: 0 microversion: 2.20 time: 0.023751 Jul 01 19:59:45.233787 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 403/815] 10.222.0.66 () {60 vars in 1258 bytes} [Fri Jul 1 19:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-609899576 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 01 19:59:46.998366 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:46.998864 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:47.005912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:47.006361 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:47.007126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:47.007645 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:47.021817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] HTTP exception thrown: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Request method failure captured: Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d HTTP/1.1 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CUTtCUlOrvsuEbpRVe7KfqcssFKv9MhQLSuJimsccSd_BZZP-V3BZizkFIK3VloxX2R9PUE4oMzLTWewZHLfcN8tU7XHXzpwKJcrFXkbWbNdKeFHghtxXDsgFSWhLET4MhJgpjUrndw5J4KNCtiuZ60qgpMlaKHdSXXbfXML376rc Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:47.023479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3307be3159654f55be46e75c82584bf0 Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.025066 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'aebdcfdb-f355-4d88-94a2-ef1d4191f28d'} Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:47.025974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.027249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.029415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Returning 404 to user: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:47.029415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-db9e32db-6b4d-49ba-b181-cbfdc9c2cdcb tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 404 len: 111 microversion: 2.20 time: 0.030549 Jul 01 19:59:47.029415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 413/816] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 1 19:59:46 2022] DELETE /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:59:47.033762 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:47.034558 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: aebdcfdb-f355-4d88-94a2-ef1d4191f28d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:47.037789 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 19:59:47.043486 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:47.043937 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:47.044699 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:47.045138 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:47.060967 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] HTTP exception thrown: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Request method failure captured: Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d HTTP/1.1 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CUTtCUlOrvsuEbpRVe7KfqcssFKv9MhQLSuJimsccSd_BZZP-V3BZizkFIK3VloxX2R9PUE4oMzLTWewZHLfcN8tU7XHXzpwKJcrFXkbWbNdKeFHghtxXDsgFSWhLET4MhJgpjUrndw5J4KNCtiuZ60qgpMlaKHdSXXbfXML376rc Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:59:47.062837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3307be3159654f55be46e75c82584bf0 Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.064436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'aebdcfdb-f355-4d88-94a2-ef1d4191f28d'} Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:47.065387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. Jul 01 19:59:47.066969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:47.068826 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Returning 404 to user: Instance aebdcfdb-f355-4d88-94a2-ef1d4191f28d could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:47.068826 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4ae95b34-b19b-4f90-b55b-8ec0ee22a88e tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d" status: 404 len: 111 microversion: 2.20 time: 0.034384 Jul 01 19:59:47.068826 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 404/817] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:47 2022] GET /compute/v2.1/servers/aebdcfdb-f355-4d88-94a2-ef1d4191f28d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 19:59:48.202599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:48.203100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:48.209792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:48.210259 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:48.211035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:48.211474 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:48.224622 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] HTTP exception thrown: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Request method failure captured: Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 HTTP/1.1 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1CUTtCUlOrvsuEbpRVe7KfqcssFKv9MhQLSuJimsccSd_BZZP-V3BZizkFIK3VloxX2R9PUE4oMzLTWewZHLfcN8tU7XHXzpwKJcrFXkbWbNdKeFHghtxXDsgFSWhLET4MhJgpjUrndw5J4KNCtiuZ60qgpMlaKHdSXXbfXML376rc Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 19:59:48.226198 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 3307be3159654f55be46e75c82584bf0 Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.227788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '4fe1a243-f161-4e1a-ada3-d5ef02346b96'} Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:48.228665 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.230139 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.231600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Returning 404 to user: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:48.231600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-469bcfec-419c-45dd-91f4-20f918be959f tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 404 len: 111 microversion: 2.20 time: 0.028838 Jul 01 19:59:48.231600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 414/818] 10.222.0.66 () {60 vars in 1279 bytes} [Fri Jul 1 19:59:48 2022] DELETE /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 01 19:59:48.236263 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 19:59:48.236876 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] [instance: 4fe1a243-f161-4e1a-ada3-d5ef02346b96] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 19:59:48.244250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:48.244699 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:48.245467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 19:59:48.245928 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 19:59:48.259620 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] HTTP exception thrown: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Request method failure captured: Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 HTTP/1.1 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1CUTtCUlOrvsuEbpRVe7KfqcssFKv9MhQLSuJimsccSd_BZZP-V3BZizkFIK3VloxX2R9PUE4oMzLTWewZHLfcN8tU7XHXzpwKJcrFXkbWbNdKeFHghtxXDsgFSWhLET4MhJgpjUrndw5J4KNCtiuZ60qgpMlaKHdSXXbfXML376rc Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Openstack-Nova-Api-Version: 2.20 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 19:59:48.261127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b8e38ec3f92a47fe98829eb3d289cdb4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: b8e38ec3f92a47fe98829eb3d289cdb4 Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1048603376 Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 3307be3159654f55be46e75c82584bf0 Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1048603376-project Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.262743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '4fe1a243-f161-4e1a-ada3-d5ef02346b96'} Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 19:59:48.263612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. Jul 01 19:59:48.265198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 19:59:48.266667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] Returning 404 to user: Instance 4fe1a243-f161-4e1a-ada3-d5ef02346b96 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 19:59:48.266667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-cc2f2dc8-e992-448d-a4c2-64b99323ec81 tempest-AttachVolumeShelveTestJSON-1048603376 tempest-AttachVolumeShelveTestJSON-1048603376-project] 10.222.0.66 "GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96" status: 404 len: 111 microversion: 2.20 time: 0.030265 Jul 01 19:59:48.266667 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 405/819] 10.222.0.66 () {60 vars in 1276 bytes} [Fri Jul 1 19:59:48 2022] GET /compute/v2.1/servers/4fe1a243-f161-4e1a-ada3-d5ef02346b96 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 01 20:00:16.966215 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:16.966837 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:16.968957 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:16.969624 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=39 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:16.976943 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:16.977498 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:16.978286 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:16.978723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.002097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-69c6442c-d830-49f2-8875-3c99ef3683ff tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/ips" status: 200 len: 150 microversion: 2.1 time: 0.039815 Jul 01 20:00:17.002661 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 415/820] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 20:00:16 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:17.014343 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:17.015616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:17.017753 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:17.018399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=5 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:17.025317 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:17.025802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.026576 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:17.027010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.109070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Invalid volume: volume 2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab is already attached to instances: eb94df28-2151-48bf-9571-ae16d23c66a6 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: POST /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/os-volume_attachments HTTP/1.1 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 74 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:00:17.110726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {"volumeAttachment": {"volumeId": "2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab"}} Jul 01 20:00:17.112389 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Invalid volume: volume 2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab is already attached to instances: eb94df28-2151-48bf-9571-ae16d23c66a6 Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'server_id': 'c19da010-1763-4196-8876-e78433c1e0cb', 'body': {'volumeAttachment': {'volumeId': '2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab'}}} Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab is already attached to instances: eb94df28-2151-48bf-9571-ae16d23c66a6 Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:17.113331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab is already attached to instances: eb94df28-2151-48bf-9571-ae16d23c66a6 Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:17.115599 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab is already attached to instances: eb94df28-2151-48bf-9571-ae16d23c66a6 Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 400 to user: Invalid volume: volume 2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab is already attached to instances: eb94df28-2151-48bf-9571-ae16d23c66a6 {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9e0cf680-cb12-4af4-a744-05f6418a1188 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101969 Jul 01 20:00:17.117076 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 406/821] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 20:00:17 2022] POST /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 20:00:17.121754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:17.122258 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:17.128339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:17.128792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.130207 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:17.130838 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.156089 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:00:17.230838 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c30fd2e6-854a-42d8-8743-33d2f54e5c20 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 204 len: 0 microversion: 2.1 time: 0.112520 Jul 01 20:00:17.231344 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 416/822] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:00:17 2022] DELETE /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:00:17.240670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:17.241291 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:17.248186 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:17.248635 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.249397 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:17.249863 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:17.378622 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:17.386890 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-980a7e36-fdbf-4fe9-a0b8-1086daf15d31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1681 microversion: 2.1 time: 0.150867 Jul 01 20:00:17.387445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 407/823] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:17 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:18.253349 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1862510164", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:18.306453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] validate_networks() for None {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 20:00:18.404244 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:18.404854 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:18.412226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:18.412709 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:18.413460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:18.413945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:18.648422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 20:00:18.648850 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 20:00:18.649329 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 20:00:18.649770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 20:00:18.650195 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 20:00:18.651726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:18.659147 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:18.659303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3d093387-6a7d-4a6b-a74c-9ffc91a1d612 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1681 microversion: 2.1 time: 0.258878 Jul 01 20:00:18.659608 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:18.659783 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 408/824] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:18 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:18.660436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:18.661389 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:18.678434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Getting quotas for project 3d943354675349cfad1ff664576eb094. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:00:18.682411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Getting quotas for user 6ebbfd0fcf4b4a32bb801b1c9bdc99e6 and project 3d943354675349cfad1ff664576eb094. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:00:18.693488 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 20:00:18.695840 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 20:00:18.740595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0ed92e4b-b8d5-4dca-849c-4c27fad3a2cc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.491350 Jul 01 20:00:18.741234 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 417/825] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 20:00:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 493 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 20:00:18.751217 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5d25ebc6-8dce-43d3-b4e5-b563d6e6d74e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:18.751837 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5d25ebc6-8dce-43d3-b4e5-b563d6e6d74e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:18.806509 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5d25ebc6-8dce-43d3-b4e5-b563d6e6d74e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:18.813317 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5d25ebc6-8dce-43d3-b4e5-b563d6e6d74e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1215 microversion: 2.1 time: 0.066035 Jul 01 20:00:18.813939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 409/826] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:18 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:19.676986 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:19.677621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:19.683800 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:19.684250 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:19.685009 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:19.685444 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:19.811951 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:19.819545 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-10793b1d-444a-4b51-bfd4-dc729da944a5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1681 microversion: 2.1 time: 0.147188 Jul 01 20:00:19.820112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 418/827] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:19 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:19.830132 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:19.830744 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:19.837765 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:19.838215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:19.839007 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:19.839449 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:19.904240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:19.912357 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7db3d196-d798-4166-afd4-81c6fa2b39bc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1219 microversion: 2.1 time: 0.086011 Jul 01 20:00:19.912916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 410/828] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:19 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:20.836635 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:20.837255 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:20.844073 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:20.844528 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:20.845290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:20.845771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:20.929127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:20.929789 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:20.936395 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:20.936841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:20.937631 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:20.938069 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:20.974892 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:20.982655 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-6f01558b-5f85-41e1-8062-40d9d6ac81e1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1681 microversion: 2.1 time: 0.150461 Jul 01 20:00:20.983241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 419/829] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:20 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:21.006126 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:21.013429 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2ec2decc-0731-4667-8ca7-dfcee225e65e tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1219 microversion: 2.1 time: 0.088311 Jul 01 20:00:21.014028 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 411/830] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:20 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:22.000373 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:22.000980 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:22.008132 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:22.008580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:22.009343 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:22.009803 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:22.030428 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:22.031175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:22.038522 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:22.038986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:22.039764 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:22.040210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:22.141433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:22.150517 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3269cfea-e1fc-4c84-87aa-6d92b4b105f7 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1273 microversion: 2.1 time: 0.123860 Jul 01 20:00:22.159933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 412/831] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:22 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1273 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:22.314371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:22.322774 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b3dc7560-62c3-4b6f-bd99-7e5acdf2cfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1681 microversion: 2.1 time: 0.326125 Jul 01 20:00:22.323408 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 420/832] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:21 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1681 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:23.105484 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-b753dfe8-9ff4-4fc0-807b-fa1a12e497ad req-9d29d438-fc4d-4c7b-b85a-7bafc1cced21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c19da010-1763-4196-8876-e78433c1e0cb", "name": "network-vif-deleted", "tag": "98b20cd5-6624-4dbe-9595-c5388d391222"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:23.131228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b753dfe8-9ff4-4fc0-807b-fa1a12e497ad req-9d29d438-fc4d-4c7b-b85a-7bafc1cced21 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:23.131866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b753dfe8-9ff4-4fc0-807b-fa1a12e497ad req-9d29d438-fc4d-4c7b-b85a-7bafc1cced21 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:23.147301 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-b753dfe8-9ff4-4fc0-807b-fa1a12e497ad req-9d29d438-fc4d-4c7b-b85a-7bafc1cced21 service nova] Creating event network-vif-deleted:98b20cd5-6624-4dbe-9595-c5388d391222 for instance c19da010-1763-4196-8876-e78433c1e0cb on hv-cinder-84460 Jul 01 20:00:23.153750 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-b753dfe8-9ff4-4fc0-807b-fa1a12e497ad req-9d29d438-fc4d-4c7b-b85a-7bafc1cced21 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052848 Jul 01 20:00:23.154961 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 413/833] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:23.167954 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:23.168576 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:23.175314 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:23.176698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:23.178115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:23.178755 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:23.342190 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:23.343868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:23.352289 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:23.353104 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:23.354169 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:23.354817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:23.384902 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:23.394457 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4adcc18f-7ee6-4467-89a7-b37c4a0a9266 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.229760 Jul 01 20:00:23.403240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 421/834] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:23 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:23.407163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:23.407648 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:23.408106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'fault' on Instance uuid c19da010-1763-4196-8876-e78433c1e0cb {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:00:23.456454 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:23.465716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7f072730-15aa-4a6b-94a2-0aad46885770 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 200 len: 1330 microversion: 2.1 time: 0.128089 Jul 01 20:00:23.466685 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 414/835] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:23 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 1330 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:24.413497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:24.414680 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:24.421786 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:24.422520 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:24.423496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:24.424105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:24.484294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:24.484970 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:24.494479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:24.494934 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:24.496001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:24.496314 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:24.512545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb HTTP/1.1 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:00:24.514252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:00:24.515899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'c19da010-1763-4196-8876-e78433c1e0cb'} Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:00:24.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:00:24.518303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:00:24.521228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:00:24.522373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d3c20cb6-4f4e-4fc9-b440-98b52f3627ae tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 404 len: 111 microversion: 2.1 time: 0.042039 Jul 01 20:00:24.522958 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 415/836] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:24 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 20:00:24.532569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a6b23b5b-d109-495a-b715-72705af6c3c5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '.version_select at 0x7fa007435ca0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:24.553869 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a6b23b5b-d109-495a-b715-72705af6c3c5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-543948058" status: 202 len: 0 microversion: 2.1 time: 0.025357 Jul 01 20:00:24.554919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 416/837] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 1 20:00:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-543948058 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:00:24.674842 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:24.688246 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-83bf99bb-9ed7-459a-aec6-39156dc89fe3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.279479 Jul 01 20:00:24.689575 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 422/838] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:24 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:25.197059 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-38498580-94ec-4912-88fa-d30362584684 req-0a2ad7f1-fc9f-4b4f-bfdc-66c4293e29a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b37a2dd0-c444-4989-a8bf-f63f8bbcedc5", "tag": "a6e67f2a-5ad1-424e-a09c-14bfd77daa5f"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:25.212847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-38498580-94ec-4912-88fa-d30362584684 req-0a2ad7f1-fc9f-4b4f-bfdc-66c4293e29a2 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.213702 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-38498580-94ec-4912-88fa-d30362584684 req-0a2ad7f1-fc9f-4b4f-bfdc-66c4293e29a2 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.240033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-38498580-94ec-4912-88fa-d30362584684 req-0a2ad7f1-fc9f-4b4f-bfdc-66c4293e29a2 service nova] Creating event network-changed:a6e67f2a-5ad1-424e-a09c-14bfd77daa5f for instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 on hv-cinder-84460 Jul 01 20:00:25.249985 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-38498580-94ec-4912-88fa-d30362584684 req-0a2ad7f1-fc9f-4b4f-bfdc-66c4293e29a2 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055919 Jul 01 20:00:25.250973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 417/839] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:25.306397 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:25.307427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:25.318340 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.319118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.320411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.321180 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.409423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'services' on Instance uuid eb94df28-2151-48bf-9571-ae16d23c66a6 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:00:25.484830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b8431af7-8f1c-41aa-8bd4-be07772894ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments/2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab" status: 202 len: 0 microversion: 2.1 time: 0.184035 Jul 01 20:00:25.485452 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 423/840] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 20:00:25 2022] DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments/2bd37a83-0f0e-4cd9-9d80-d73b6e01a7ab => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:00:25.494250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:25.495282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:25.502099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.502555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.503319 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.503756 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.533551 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1cbfeffc-141f-4b9a-b3a3-8e859f0e84e2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043479 Jul 01 20:00:25.534069 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 418/841] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:00:25 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:25.704836 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:25.705533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:25.711867 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.712313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.713069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:25.713510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:25.843403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:25.851907 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a450bb26-c205-4dbc-8727-985cf4ddeab6 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.151289 Jul 01 20:00:25.852521 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 424/842] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:25 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:26.549220 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:26.551937 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:26.565227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:26.566227 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:26.568451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:26.569127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:26.618508 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a686e94e-8fea-4360-9c66-3d93e5133d2f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075805 Jul 01 20:00:26.619991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 419/843] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:00:26 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:26.868845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:26.869563 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:26.876086 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:26.876535 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:26.877298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:26.877777 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:27.019553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:27.027176 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-86d29af2-9d35-4b30-b7db-80c2907a2bf2 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.162312 Jul 01 20:00:27.027748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 425/844] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:26 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:27.632064 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:27.632970 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:27.639518 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:27.639954 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:27.640698 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:27.641124 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:27.672007 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c1d1d079-6ea8-4e0a-ad08-3ee44606ef11 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045097 Jul 01 20:00:27.672539 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 420/845] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:00:27 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 20:00:27.731626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:27.732124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:27.738204 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:27.738948 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:27.739468 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:27.739906 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:27.764258 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:00:27.843796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8c5bcb99-d793-451e-89f4-0d8059310445 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 204 len: 0 microversion: 2.1 time: 0.115602 Jul 01 20:00:27.845433 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 426/846] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:00:27 2022] DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:00:27.854582 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:27.855651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:27.861885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:27.862326 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:27.863072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:27.863822 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:28.002152 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:28.012007 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7b18b194-57e0-4543-88ff-c99e7948f700 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1682 microversion: 2.1 time: 0.161601 Jul 01 20:00:28.012588 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 421/847] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:27 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:28.044680 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:28.045290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:28.051846 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:28.052323 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:28.053380 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:28.053847 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:28.183298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:28.190672 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-56b913ca-0faf-42ea-a6f8-11825f8b4174 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.150261 Jul 01 20:00:28.191226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 427/848] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:28 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:29.030941 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:29.031565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:29.034828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:29.042096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:29.042548 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:29.043320 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:29.043757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:29.208031 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:29.209869 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:29.211988 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:29.212909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:29.220586 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:29.221054 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:29.222374 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:29.222823 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:29.228466 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:29.236859 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-751d1c5a-74ef-45fc-a171-99eda88ebc8f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1682 microversion: 2.1 time: 0.209926 Jul 01 20:00:29.237446 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 422/849] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:29 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1682 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:29.252643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:29.275142 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-70702146-6f3c-4cd9-9aa2-93685efc9dbf req-81739f2f-8438-4bad-8fcb-d8e4740c3377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37a2dd0-c444-4989-a8bf-f63f8bbcedc5", "name": "network-vif-plugged", "status": "completed", "tag": "a6e67f2a-5ad1-424e-a09c-14bfd77daa5f"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:29.284585 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-70702146-6f3c-4cd9-9aa2-93685efc9dbf req-81739f2f-8438-4bad-8fcb-d8e4740c3377 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:29.285046 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-70702146-6f3c-4cd9-9aa2-93685efc9dbf req-81739f2f-8438-4bad-8fcb-d8e4740c3377 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:29.300183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-70702146-6f3c-4cd9-9aa2-93685efc9dbf req-81739f2f-8438-4bad-8fcb-d8e4740c3377 service nova] Creating event network-vif-plugged:a6e67f2a-5ad1-424e-a09c-14bfd77daa5f for instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 on hv-cinder-84460 Jul 01 20:00:29.307145 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-70702146-6f3c-4cd9-9aa2-93685efc9dbf req-81739f2f-8438-4bad-8fcb-d8e4740c3377 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036652 Jul 01 20:00:29.307773 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 423/850] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:29.387299 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:29.394927 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8684071a-3427-455d-a29b-be4d284b68d3 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.190885 Jul 01 20:00:29.395491 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 428/851] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:29 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:30.255851 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:30.256453 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:30.263153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:30.263597 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:30.264380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:30.264810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:30.397573 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:30.404992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-68bcb3e8-3aa7-4560-9818-e4cb33bdbd01 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1682 microversion: 2.1 time: 0.153530 Jul 01 20:00:30.405555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 424/852] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:30 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:30.412511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:30.413145 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:30.419841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:30.420292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:30.421090 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:30.421527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:30.549643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:30.557777 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f18d6298-9225-4e84-94ad-d03305caeb89 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.149808 Jul 01 20:00:30.558364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 429/853] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:30 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:31.422915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:31.423520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:31.431248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:31.431697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:31.432467 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:31.432904 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:31.565913 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:31.573645 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5918a0e0-0e9e-435b-82ef-ee65d2a39ee9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1682 microversion: 2.1 time: 0.154650 Jul 01 20:00:31.574212 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 425/854] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:31 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:31.574592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:31.575199 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:31.581702 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:31.582153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:31.582911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:31.583912 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:31.714446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:31.721682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1a981e1e-2e4d-4fe5-9bc6-a553a03837ea tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.150823 Jul 01 20:00:31.722248 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 430/855] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:31 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:32.590839 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:32.591459 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:32.598041 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:32.598490 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:32.599741 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:32.600275 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:32.730134 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:32.733752 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:32.738553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:32.739053 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7453c413-d7d8-4e9e-a1e5-907de8b26b3b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1682 microversion: 2.1 time: 0.151748 Jul 01 20:00:32.739288 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:32.741290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 426/856] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:32 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:32.746168 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:32.746620 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:32.747379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:32.747817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:32.877103 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:32.884659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0e2d7487-46bf-43a9-afba-053910cba805 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.150311 Jul 01 20:00:32.885226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 431/857] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:32 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:33.757207 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:33.757815 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:33.765193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:33.765716 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:33.766445 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:33.766871 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:33.902132 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:33.902851 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:33.909826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:33.910269 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:33.911099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:33.911533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:33.919603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:33.927512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f64b81a0-4a2e-4cd4-bfc3-0208cf0acfa6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1682 microversion: 2.1 time: 0.174861 Jul 01 20:00:33.928283 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 427/858] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:33 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1682 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:34.137983 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:34.145544 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b07350b4-e9ec-4d64-aac2-8da2b3556247 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1315 microversion: 2.1 time: 0.247851 Jul 01 20:00:34.146851 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 432/859] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:33 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:34.919515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-1ae7ec75-7f65-4f96-ac7d-7493c6955c75 req-1b3bbe15-ace7-49fc-868f-d5bd4042b977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb94df28-2151-48bf-9571-ae16d23c66a6", "name": "network-vif-deleted", "tag": "1a187327-634a-45da-978e-23ca2730d31b"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:34.929487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-1ae7ec75-7f65-4f96-ac7d-7493c6955c75 req-1b3bbe15-ace7-49fc-868f-d5bd4042b977 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:34.930052 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-1ae7ec75-7f65-4f96-ac7d-7493c6955c75 req-1b3bbe15-ace7-49fc-868f-d5bd4042b977 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:34.945747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-1ae7ec75-7f65-4f96-ac7d-7493c6955c75 req-1b3bbe15-ace7-49fc-868f-d5bd4042b977 service nova] Creating event network-vif-deleted:1a187327-634a-45da-978e-23ca2730d31b for instance eb94df28-2151-48bf-9571-ae16d23c66a6 on hv-cinder-84460 Jul 01 20:00:34.945905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:34.946447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:34.951795 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-1ae7ec75-7f65-4f96-ac7d-7493c6955c75 req-1b3bbe15-ace7-49fc-868f-d5bd4042b977 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036143 Jul 01 20:00:34.952912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 428/860] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:34.963365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:34.964158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:34.965237 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:34.965949 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.038158 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:35.048594 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e706df71-f8f6-4ecc-8a18-950be670d0f9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1614 microversion: 2.1 time: 0.106788 Jul 01 20:00:35.050244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 433/861] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:34 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1614 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:35.162779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:35.163577 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:35.170132 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:35.170840 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.171789 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:35.172387 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.318758 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:35.326602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8a4f9ac9-739e-4944-8ddf-f0bca161c3fc tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1465 microversion: 2.1 time: 0.168102 Jul 01 20:00:35.327248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 429/862] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:35 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1465 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:35.367096 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:35.367590 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:35.373496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:35.373977 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.374731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:35.375166 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.401124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:00:35.492515 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-594db978-acb8-4cd3-86e1-4f484b11d674 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "DELETE /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 204 len: 0 microversion: 2.1 time: 0.128719 Jul 01 20:00:35.493175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 434/863] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:00:35 2022] DELETE /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:00:35.501726 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:35.502421 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:35.509755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:35.510277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.511170 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:35.511839 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:35.658695 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:35.666962 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9641b52f-1cb4-4015-9c77-25d2c9ce2f63 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1471 microversion: 2.1 time: 0.169367 Jul 01 20:00:35.667529 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 430/864] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:35 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:36.067242 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:36.068616 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:36.075018 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:36.075461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:36.076209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:36.076639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:36.107541 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:36.107990 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:36.108439 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'fault' on Instance uuid eb94df28-2151-48bf-9571-ae16d23c66a6 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:00:36.150001 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:36.157409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5d3e3737-32e8-4454-ac5b-bf8473cbdae4 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 200 len: 1331 microversion: 2.1 time: 0.094385 Jul 01 20:00:36.158011 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 435/865] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:36 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:36.684376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:36.685042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:36.691689 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:36.692140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:36.693547 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:36.694006 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:36.824375 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:36.835849 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f6e58930-6014-4c9c-a186-3c496e4a26d8 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1471 microversion: 2.1 time: 0.155228 Jul 01 20:00:36.836748 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 431/866] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:36 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:37.174485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:37.175098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:37.182194 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:37.182643 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:37.183406 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:37.183838 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:37.198855 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 HTTP/1.1 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:00:37.200749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:00:37.202469 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'eb94df28-2151-48bf-9571-ae16d23c66a6'} Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:00:37.203396 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:00:37.204936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:37.206363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:00:37.206363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-23045a27-4459-49c4-a1b1-fc3e482abec7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 404 len: 111 microversion: 2.1 time: 0.032504 Jul 01 20:00:37.206363 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 436/867] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:37 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 20:00:37.212264 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-587454dd-5e47-469e-80c0-f57b6f75d29a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '.version_select at 0x7fa0076d29d0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:37.231522 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-587454dd-5e47-469e-80c0-f57b6f75d29a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025854016" status: 202 len: 0 microversion: 2.1 time: 0.023108 Jul 01 20:00:37.232364 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 432/868] 10.222.0.66 () {58 vars in 1220 bytes} [Fri Jul 1 20:00:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1025854016 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:00:37.764144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-107a5c7f-7072-4888-ac50-71ba235a2588 req-a8bad3be-1643-4542-b566-69dea9ab319b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b37a2dd0-c444-4989-a8bf-f63f8bbcedc5", "name": "network-vif-deleted", "tag": "a6e67f2a-5ad1-424e-a09c-14bfd77daa5f"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:37.781186 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-107a5c7f-7072-4888-ac50-71ba235a2588 req-a8bad3be-1643-4542-b566-69dea9ab319b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:37.782228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-107a5c7f-7072-4888-ac50-71ba235a2588 req-a8bad3be-1643-4542-b566-69dea9ab319b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:37.805453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-107a5c7f-7072-4888-ac50-71ba235a2588 req-a8bad3be-1643-4542-b566-69dea9ab319b service nova] Creating event network-vif-deleted:a6e67f2a-5ad1-424e-a09c-14bfd77daa5f for instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 on hv-cinder-84460 Jul 01 20:00:37.827292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-107a5c7f-7072-4888-ac50-71ba235a2588 req-a8bad3be-1643-4542-b566-69dea9ab319b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067800 Jul 01 20:00:37.827897 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 437/869] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:37.854078 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:37.855409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:37.867002 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:37.872095 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:37.873161 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:37.873817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:37.941412 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:37.941885 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:37.942853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lazy-loading 'fault' on Instance uuid b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:00:38.002048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ebbfd0fcf4b4a32bb801b1c9bdc99e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d943354675349cfad1ff664576eb094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:38.012259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-898f83de-665c-45aa-99b7-ee95b5123719 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 200 len: 1305 microversion: 2.1 time: 0.163063 Jul 01 20:00:38.013885 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4100fbda-4a7c-4fd2-bae6-84515e7c31a9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: .version_select at 0x7fa007442d30>, body: {"keypair": {"name": "tempest-keypair-2012609850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNwYMJdbp0Whpqqkb2OnT3qM85dqp0CrUf0a8O/OA5Hp+VEgpFPBdgyaQOe9w3BwnB0wD6LhNdy5tu4yncR/wwAzoDuDuhlp2JGYtT4AjBD5JAKOdsItYcvawvTHxvUiw=="}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:38.017968 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 433/870] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:37 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 1305 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:38.030065 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-4100fbda-4a7c-4fd2-bae6-84515e7c31a9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:00:38.034157 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-4100fbda-4a7c-4fd2-bae6-84515e7c31a9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:00:38.062080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4100fbda-4a7c-4fd2-bae6-84515e7c31a9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.052521 Jul 01 20:00:38.063183 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 438/871] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 20:00:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:00:38.130451 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-112883743", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1633635879", "security_groups": [{"name": "tempest-secgroup-smoke-1127916334"}], "block_device_mapping_v2": [{"uuid": "daf72d0f-81bf-450c-a9c8-e02de9712f72", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e8fd60a7-929d-43ab-ae8d-d1c7691811e9"}]}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:38.312607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] validate_networks() for [('e8fd60a7-929d-43ab-ae8d-d1c7691811e9', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 20:00:38.868819 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 20:00:38.869444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 20:00:38.869756 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 20:00:38.870173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 20:00:38.870590 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 20:00:38.881745 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:38.882195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:38.883167 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:38.883604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:38.902817 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for project 262e5b1a6f6248cca455437d23b8d441. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:00:38.906850 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Getting quotas for user 80267c31f3fc4b3fbc8dc7ed03326eeb and project 262e5b1a6f6248cca455437d23b8d441. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:00:38.976294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 20:00:38.978639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='daf72d0f-81bf-450c-a9c8-e02de9712f72',volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 20:00:39.032032 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:39.032924 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] [instance: b37a2dd0-c444-4989-a8bf-f63f8bbcedc5] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:39.040147 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:39.040704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:39.041757 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:39.042294 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:39.056585 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] HTTP exception thrown: Instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 could not be found. Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Request method failure captured: Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 HTTP/1.1 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1JOBcV900eZtMzUkexXdESLGUkPhEOIimIjPmMCUeEtmrN4c0GBWX5kWHJQiYOciXlfQyOf_n1sQ7b91X8BAw71PNiCyoEJAeemlbvcCSU9Sm2B0DZ_ALHCgm7sqzlRHQSwl5d0s4L91_vxwYLwCpiWjOX9zKcBlOGOAVe5X7tKVu8 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 3d943354675349cfad1ff664576eb094 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesNegativeTest-2035209834 Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:00:39.060035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_3d943354675349cfad1ff664576eb094"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/3d943354675349cfad1ff664576eb094"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d943354675349cfad1ff664576eb094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/3d943354675349cfad1ff664576eb094"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesNegativeTest-2035209834 Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 3d943354675349cfad1ff664576eb094 Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesNegativeTest-2035209834 Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesNegativeTest-2035209834-project Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 6ebbfd0fcf4b4a32bb801b1c9bdc99e6 Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesNegativeTest-2035209834-project Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 could not be found. Jul 01 20:00:39.061369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'b37a2dd0-c444-4989-a8bf-f63f8bbcedc5'} Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 could not be found. Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:00:39.062175 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 could not be found. Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 could not be found. Jul 01 20:00:39.063369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:00:39.066063 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] Returning 404 to user: Instance b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:00:39.067320 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-82601b18-ff07-4c7d-8847-154e59ed42f9 tempest-VolumesNegativeTest-2035209834 tempest-VolumesNegativeTest-2035209834-project] 10.222.0.66 "GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5" status: 404 len: 111 microversion: 2.1 time: 0.040061 Jul 01 20:00:39.068461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 439/872] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:39 2022] GET /compute/v2.1/servers/b37a2dd0-c444-4989-a8bf-f63f8bbcedc5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:00:39.148477 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e762b062-6562-403e-b660-0be24969f067 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.022015 Jul 01 20:00:39.150113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 434/873] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 20:00:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 20:00:39.161836 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-aa8c9bc4-7a14-41da-b196-5a5b2bcf7545 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:39.162698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-aa8c9bc4-7a14-41da-b196-5a5b2bcf7545 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:39.265138 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-aa8c9bc4-7a14-41da-b196-5a5b2bcf7545 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:39.275940 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-aa8c9bc4-7a14-41da-b196-5a5b2bcf7545 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1094 microversion: 2.1 time: 0.118786 Jul 01 20:00:39.277887 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 440/874] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:39 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1094 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:39.953718 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1008206225", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd301699-ca40-48e9-9559-67a73cd4bb19"}], "security_groups": [{"name": "tempest-securitygroup--1703601003"}], "key_name": "tempest-keypair-2012609850", "user_data": "}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:40.071033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.network.neutron [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] validate_networks() for [('bd301699-ca40-48e9-9559-67a73cd4bb19', None, None, None, None, None)] {{(pid=124286) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 20:00:40.294546 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:40.296071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:40.307619 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=4 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:40.309905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:40.310365 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:40.311414 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:40.312039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:40.448004 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:40.463866 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ef6d3350-e829-4694-8b2e-0561661c861c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1200 microversion: 2.1 time: 0.174359 Jul 01 20:00:40.473353 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 441/875] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:40 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1200 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:40.832366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 20:00:40.834265 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image limits 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 20:00:40.834956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 20:00:40.835655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image pref 0:0:0 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 20:00:40.836289 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.virt.hardware [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124286) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 20:00:40.847992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:40.848609 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:40.850101 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:40.850793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:40.877965 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:00:40.885639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:00:40.903090 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Going to run 1 instances... {{(pid=124286) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 20:00:40.905414 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124286) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 20:00:40.925261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:40.980444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-825346a0-be29-4e97-aa2f-09df83376fed tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.031812 Jul 01 20:00:40.988226 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 435/876] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 20:00:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 20:00:41.001079 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d2adcaaf-57f9-46a4-9e3d-bfed1d0c3526 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:41.002021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d2adcaaf-57f9-46a4-9e3d-bfed1d0c3526 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:41.135594 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d2adcaaf-57f9-46a4-9e3d-bfed1d0c3526 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:41.148473 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d2adcaaf-57f9-46a4-9e3d-bfed1d0c3526 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1242 microversion: 2.1 time: 0.150926 Jul 01 20:00:41.152845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 442/877] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:40 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:41.492225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:41.493246 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:41.515554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:41.515998 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:41.516793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:41.518096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:41.866738 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:41.892063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-77b31b5e-b09c-4bb0-952a-f18e036e194a tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.405729 Jul 01 20:00:41.893911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 436/878] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:41 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:42.177534 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:42.178905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:42.196700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:42.199935 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:42.201790 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:42.202750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:42.429821 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:42.461677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ba8e74bb-3061-40b4-9620-c2b1a3e8e4cf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1294 microversion: 2.1 time: 0.286932 Jul 01 20:00:42.462330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 443/879] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:42 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1294 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:42.910554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:42.911844 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:42.921777 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:42.922215 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:42.923000 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:42.923432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:43.273989 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:43.292691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-f975c373-b9be-40df-857c-ca3943b0c047 req-cc67e9a7-cacf-42a6-bf39-3959fefc6f69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc669e16-66da-4c61-bfae-4d266c6b16d8", "tag": "6adc29b3-1960-40fd-8ad1-4dfc34d21261"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:43.301952 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9e39079e-c30d-47d0-9028-9fcb99d6ba04 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.394744 Jul 01 20:00:43.312015 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 437/880] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:42 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:43.312313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-f975c373-b9be-40df-857c-ca3943b0c047 req-cc67e9a7-cacf-42a6-bf39-3959fefc6f69 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:43.312313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-f975c373-b9be-40df-857c-ca3943b0c047 req-cc67e9a7-cacf-42a6-bf39-3959fefc6f69 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:43.319415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-f975c373-b9be-40df-857c-ca3943b0c047 req-cc67e9a7-cacf-42a6-bf39-3959fefc6f69 service nova] Creating event network-changed:6adc29b3-1960-40fd-8ad1-4dfc34d21261 for instance cc669e16-66da-4c61-bfae-4d266c6b16d8 on hv-cinder-84460 Jul 01 20:00:43.327554 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-f975c373-b9be-40df-857c-ca3943b0c047 req-cc67e9a7-cacf-42a6-bf39-3959fefc6f69 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039015 Jul 01 20:00:43.328217 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 444/881] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:00:43.479601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:43.480248 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:43.490107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:43.490487 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:43.491270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:43.491710 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:43.599455 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:43.607294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f172a4ac-71df-4b1c-a4d3-a5bbccdd33af tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1300 microversion: 2.1 time: 0.131777 Jul 01 20:00:43.608080 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 438/882] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:43 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1300 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:44.321263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:44.322040 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:44.328305 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:44.328756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:44.329527 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:44.329993 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:44.465321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:44.473036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-62af2feb-fd42-4cf4-b585-3488c36fbffb tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.157600 Jul 01 20:00:44.473632 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 445/883] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:44 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:44.624290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:44.624816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:44.631938 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:44.632379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:44.633224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:44.633755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:44.760284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:44.767664 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-22d545db-fb44-41fa-a611-501c2adcdabb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.147297 Jul 01 20:00:44.768224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 439/884] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:44 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:45.490916 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:45.491456 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:45.497883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:45.498313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:45.499064 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:45.499497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:45.639064 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:45.647555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7f8fe8d8-27c1-4df0-9a24-516e1849638e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.161678 Jul 01 20:00:45.648115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 446/885] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:45 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:45.784600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:45.785159 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:45.792361 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:45.792796 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:45.793545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:45.794009 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:45.921916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:45.929393 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2e2bd1b8-787a-4ae8-9d12-729d61d1f1ee tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.148731 Jul 01 20:00:45.929985 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 440/886] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:45 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:46.664896 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:46.665606 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:46.672382 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:46.672836 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:46.673628 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:46.674075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:46.938637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:46.946372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:46.947216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:46.947588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8d3d1f30-bf10-4223-af3c-50ec1a4bd602 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.287137 Jul 01 20:00:46.948173 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 447/887] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:46 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:46.962462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:46.962948 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:46.963747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:46.964183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:47.232199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:47.243784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-70ac6d0f-0b13-4238-b4e8-11317ba88627 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.301071 Jul 01 20:00:47.250499 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 441/888] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:46 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:47.606428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-308758ec-e6f8-43bd-89de-ebbd19972329 req-31b78d8d-666a-4b37-ab51-e5f124adffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac04816-f371-4f1f-a486-111e39d68532", "tag": "14c3c357-d038-4761-af70-e6a46b8da1d3"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:47.621424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-308758ec-e6f8-43bd-89de-ebbd19972329 req-31b78d8d-666a-4b37-ab51-e5f124adffd7 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:47.623448 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-308758ec-e6f8-43bd-89de-ebbd19972329 req-31b78d8d-666a-4b37-ab51-e5f124adffd7 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:47.665042 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-308758ec-e6f8-43bd-89de-ebbd19972329 req-31b78d8d-666a-4b37-ab51-e5f124adffd7 service nova] Creating event network-changed:14c3c357-d038-4761-af70-e6a46b8da1d3 for instance 7ac04816-f371-4f1f-a486-111e39d68532 on hv-cinder-84460 Jul 01 20:00:47.671369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-308758ec-e6f8-43bd-89de-ebbd19972329 req-31b78d8d-666a-4b37-ab51-e5f124adffd7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068577 Jul 01 20:00:47.673461 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 448/889] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:00:47.964734 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:47.966418 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:47.974354 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:47.975978 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:47.977050 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:47.977800 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:48.240559 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:48.248689 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3d8bd00a-ae98-40a4-8dc1-0fa90b3722b9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.288040 Jul 01 20:00:48.249380 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 442/890] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:47 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:48.269307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:48.270706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:48.276958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:48.277531 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:48.278435 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:48.279368 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:48.301144 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:48.431071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:48.438464 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-5ea9bb8e-abaa-42ca-a49e-9ae1b5e41b10 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.174318 Jul 01 20:00:48.439263 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 449/891] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:48 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:49.266048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:49.266700 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:49.274097 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:49.274566 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:49.275329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:49.275761 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:49.405755 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:49.413663 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2a411e2a-47c7-49e7-a5f3-6779bf202c20 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.151683 Jul 01 20:00:49.414225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 443/892] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:49 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:49.455969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:49.456588 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:49.462929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:49.463381 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:49.464172 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:49.464605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:49.750160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:49.757867 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8064bf4b-fc3c-4ec9-9c49-76b8377e11fd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.305894 Jul 01 20:00:49.758424 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 450/893] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:49 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:50.431192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:50.431714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:50.438176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:50.438620 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:50.439368 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:50.439800 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:50.571315 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:50.578670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ea17c2a6-482a-4460-8c87-727ec88c74c8 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.151438 Jul 01 20:00:50.579228 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 444/894] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:50 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:50.775030 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:50.775567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:50.782031 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:50.782480 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:50.783239 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:50.783677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:50.911682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:50.919132 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0c998beb-884a-4f3c-aa34-4e6bf67166d5 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.148056 Jul 01 20:00:50.919675 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 451/895] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:50 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:51.595832 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:51.596444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:51.599095 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=4 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:51.599809 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=12 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:51.606894 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:51.607342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:51.608107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:51.608545 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:51.745908 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:51.753973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-65db0e4c-185a-412c-af1f-ceea93e7ae9c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.161909 Jul 01 20:00:51.763130 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 445/896] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:51 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:51.936773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:51.937433 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:51.939644 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=8 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:51.948257 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:51.948709 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:51.949480 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:51.949954 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:52.290773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:52.298513 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-abd8d37b-25a7-41b4-b682-285821b6724b tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.365980 Jul 01 20:00:52.299071 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 452/897] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:51 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:00:52.771047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:52.771569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:52.778186 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:52.778636 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:52.779392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:52.779828 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:52.783735 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=100 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:00:52.993561 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:53.003544 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c4886da6-6402-4e53-9a0c-de976ef20cf5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.236684 Jul 01 20:00:53.004875 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 446/898] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:52 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:53.317021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:53.317664 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:53.324152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:53.324599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:53.325354 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:53.325832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:53.456865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:53.465806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-764c55c1-ec0b-453d-aaf6-f86cab16cdda tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.152754 Jul 01 20:00:53.466570 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 453/899] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:53 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:54.021056 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:54.021651 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:54.028031 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:54.028470 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:54.029219 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:54.029677 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:54.163884 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:54.171236 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d8b8e595-b052-4efc-9598-dd127ab5009c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.154858 Jul 01 20:00:54.171793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 447/900] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:54 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:54.483183 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:54.483799 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:54.491379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:54.491826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:54.492590 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:54.493026 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:54.621427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:54.628639 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8784859a-9af7-4c57-ac00-8d523ac61da2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.149436 Jul 01 20:00:54.629778 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 454/901] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:54 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:55.188290 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:55.188939 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:55.196037 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:55.196480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:55.197242 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:55.197704 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:55.334107 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:55.341497 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-07ee629a-ff47-4bfc-ace8-32fef563e18b tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.157117 Jul 01 20:00:55.342098 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 448/902] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:55 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:55.646405 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:55.647017 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:55.654048 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:55.654497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:55.655615 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:55.656054 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:55.794781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:55.803394 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-845be585-0d71-4d00-a083-648ff08663ef tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.161347 Jul 01 20:00:55.803894 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 455/903] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:55 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:56.358397 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:56.359002 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:56.365991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:56.366433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:56.367184 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:56.367615 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:56.497280 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:56.505481 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-335b1c41-d137-4157-bf0d-99559f53487d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.150918 Jul 01 20:00:56.506085 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 449/904] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:56 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:56.820638 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:56.821247 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:56.827845 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:56.828418 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:56.829248 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:56.829717 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:56.969796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:56.977436 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-15cdd903-d96c-4a46-b1f7-3a124b0bbcdf tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.161208 Jul 01 20:00:56.978027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 456/905] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:56 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:57.523402 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:57.523937 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:57.530546 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:57.530998 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:57.531760 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:57.532196 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:57.663021 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:57.670628 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e5205986-7582-4a14-9af7-80155f2aa1c1 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.151879 Jul 01 20:00:57.671194 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 450/906] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:57 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:57.996364 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:57.996971 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:58.004224 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:58.005192 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:58.006021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:58.006453 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:58.141010 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:58.149416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-007d0805-5a8d-4557-b555-4917147ef6de tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.157623 Jul 01 20:00:58.149996 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 457/907] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:57 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:58.687801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:58.688322 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:58.695406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:58.695861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:58.696659 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:58.697101 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:58.829346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:58.837192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5ec96b61-745b-4b89-90a2-ce7161a51dec tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.153349 Jul 01 20:00:58.837778 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 451/908] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:58 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:59.166970 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:59.168831 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:59.177460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:59.178273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:59.179258 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:59.179929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:59.260341 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-f3e92afc-7659-40c0-90e2-50c4bf06f1b6 req-996bd98a-b51d-4376-b41b-1ab1d85d72bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc669e16-66da-4c61-bfae-4d266c6b16d8", "name": "network-vif-plugged", "status": "completed", "tag": "6adc29b3-1960-40fd-8ad1-4dfc34d21261"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:00:59.271034 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-f3e92afc-7659-40c0-90e2-50c4bf06f1b6 req-996bd98a-b51d-4376-b41b-1ab1d85d72bf service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:59.271555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-f3e92afc-7659-40c0-90e2-50c4bf06f1b6 req-996bd98a-b51d-4376-b41b-1ab1d85d72bf service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:59.283295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-f3e92afc-7659-40c0-90e2-50c4bf06f1b6 req-996bd98a-b51d-4376-b41b-1ab1d85d72bf service nova] Creating event network-vif-plugged:6adc29b3-1960-40fd-8ad1-4dfc34d21261 for instance cc669e16-66da-4c61-bfae-4d266c6b16d8 on hv-cinder-84460 Jul 01 20:00:59.288912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-f3e92afc-7659-40c0-90e2-50c4bf06f1b6 req-996bd98a-b51d-4376-b41b-1ab1d85d72bf service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032316 Jul 01 20:00:59.289670 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 452/909] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:00:59.452618 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:00:59.466122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8f4e9200-37bd-49ed-a52c-59648792bbbc tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.302737 Jul 01 20:00:59.466853 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 458/910] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:59 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:00:59.855240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:00:59.855933 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:00:59.862097 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:59.862565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:59.864332 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:00:59.864768 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:00:59.994593 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:00.001860 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-593b8d1b-b16a-49c1-b704-b4e109d90118 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.151238 Jul 01 20:01:00.002417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 453/911] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:00:59 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:00.483731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:00.484274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:00.491388 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:00.491841 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:00.492599 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:00.493035 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:00.625277 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:00.632714 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e10c1800-ed83-406a-aa13-34b90a54511c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.153015 Jul 01 20:01:00.633267 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 459/912] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:00 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:01.020437 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:01.021047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:01.027580 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:01.028025 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:01.028792 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:01.029217 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:01.158183 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:01.165776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-08b29360-36f8-4321-aa9d-436d7b3f88fe tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.150248 Jul 01 20:01:01.166342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 454/913] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:01 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:01.306485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-9efa1bbc-be76-42d3-a661-bf0b938b96b4 req-867b89fa-d4f1-449c-8414-758cd8cf86d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac04816-f371-4f1f-a486-111e39d68532", "name": "network-vif-plugged", "status": "completed", "tag": "14c3c357-d038-4761-af70-e6a46b8da1d3"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:01.314319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9efa1bbc-be76-42d3-a661-bf0b938b96b4 req-867b89fa-d4f1-449c-8414-758cd8cf86d8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:01.314751 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9efa1bbc-be76-42d3-a661-bf0b938b96b4 req-867b89fa-d4f1-449c-8414-758cd8cf86d8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:01.326172 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-9efa1bbc-be76-42d3-a661-bf0b938b96b4 req-867b89fa-d4f1-449c-8414-758cd8cf86d8 service nova] Creating event network-vif-plugged:14c3c357-d038-4761-af70-e6a46b8da1d3 for instance 7ac04816-f371-4f1f-a486-111e39d68532 on hv-cinder-84460 Jul 01 20:01:01.331199 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-9efa1bbc-be76-42d3-a661-bf0b938b96b4 req-867b89fa-d4f1-449c-8414-758cd8cf86d8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028309 Jul 01 20:01:01.331870 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 460/914] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:01.649747 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:01.650351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:01.656515 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:01.656961 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:01.657740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:01.658176 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:01.787409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:01.804291 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-97c5a3d7-ba36-49de-8c31-5ddd09962f3e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.158276 Jul 01 20:01:01.804802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 455/915] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:01 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:01:02.183564 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:02.184274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:02.191689 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:02.191689 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:02.192496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:02.192937 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:02.436447 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:02.443756 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-efae3219-ffa9-4cf1-950e-e9df01ae786c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.264663 Jul 01 20:01:02.444319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 461/916] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:02 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:02.820735 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:02.821376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:02.827847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:02.828295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:02.829057 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:02.829491 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:02.961552 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:02.969065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-72cb1d13-9484-4dae-8015-7aa6b3c352ca tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1368 microversion: 2.1 time: 0.152266 Jul 01 20:01:02.969646 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 456/917] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:02 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:03.462637 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:03.464962 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:03.473898 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:03.474874 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:03.479893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:03.480403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:03.618592 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:03.626565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c04f4ddc-3168-4c3d-bf0b-617ff003a35f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1266 microversion: 2.1 time: 0.170438 Jul 01 20:01:03.627124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 462/918] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:03 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:03.986528 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:03.987140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:03.994363 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:03.994798 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:03.995555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:03.995985 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:04.131502 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:04.139163 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5c2f4c3e-a802-476f-906d-561665d8a67e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1559 microversion: 2.1 time: 0.156547 Jul 01 20:01:04.139759 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 457/919] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:03 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:04.156303 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:04.156799 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:04.163370 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:04.163816 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:04.164638 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:04.165077 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:04.242708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9463c55f-11fc-4043-ad77-bb1c8926492c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090206 Jul 01 20:01:04.243294 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 463/920] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 20:01:04 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:04.644694 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:04.645306 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:04.651565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:04.652013 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:04.652831 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:04.653224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:04.889654 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:04.897600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1b45fb83-d88f-4a1e-86f5-da954d8b8ba9 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1452 microversion: 2.1 time: 0.257199 Jul 01 20:01:04.898187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 458/921] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:04 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1452 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:04.916038 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:04.916646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:04.922669 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:04.923112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:04.923856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:04.924283 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:05.140715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:05.149061 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d40b52eb-2a65-4189-8c8b-2baac9a5a621 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1452 microversion: 2.1 time: 0.239342 Jul 01 20:01:05.149638 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 464/922] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:04 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1452 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:05.332240 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-6fb00758-7acd-429b-ad9e-293b6c55994b req-f73f2307-272b-4de3-b730-0b33c6ea697b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ac04816-f371-4f1f-a486-111e39d68532", "tag": "14c3c357-d038-4761-af70-e6a46b8da1d3"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:05.341382 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-6fb00758-7acd-429b-ad9e-293b6c55994b req-f73f2307-272b-4de3-b730-0b33c6ea697b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:05.341860 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-6fb00758-7acd-429b-ad9e-293b6c55994b req-f73f2307-272b-4de3-b730-0b33c6ea697b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:05.356656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-6fb00758-7acd-429b-ad9e-293b6c55994b req-f73f2307-272b-4de3-b730-0b33c6ea697b service nova] Creating event network-changed:14c3c357-d038-4761-af70-e6a46b8da1d3 for instance 7ac04816-f371-4f1f-a486-111e39d68532 on hv-cinder-84460 Jul 01 20:01:05.362342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-6fb00758-7acd-429b-ad9e-293b6c55994b req-f73f2307-272b-4de3-b730-0b33c6ea697b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Jul 01 20:01:05.366296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 459/923] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:01:06.968336 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-601ef03a-7c92-4fbd-974f-c3d3951b9de5 req-c761ae34-0455-4089-9a1d-c0e3bec58ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc669e16-66da-4c61-bfae-4d266c6b16d8", "tag": "6adc29b3-1960-40fd-8ad1-4dfc34d21261"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:06.977510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-601ef03a-7c92-4fbd-974f-c3d3951b9de5 req-c761ae34-0455-4089-9a1d-c0e3bec58ff0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:06.978102 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-601ef03a-7c92-4fbd-974f-c3d3951b9de5 req-c761ae34-0455-4089-9a1d-c0e3bec58ff0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:06.989509 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-601ef03a-7c92-4fbd-974f-c3d3951b9de5 req-c761ae34-0455-4089-9a1d-c0e3bec58ff0 service nova] Creating event network-changed:6adc29b3-1960-40fd-8ad1-4dfc34d21261 for instance cc669e16-66da-4c61-bfae-4d266c6b16d8 on hv-cinder-84460 Jul 01 20:01:06.994664 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-601ef03a-7c92-4fbd-974f-c3d3951b9de5 req-c761ae34-0455-4089-9a1d-c0e3bec58ff0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029980 Jul 01 20:01:06.995348 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 465/924] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:41.606685 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:41.607417 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:41.609639 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=48 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:41.610295 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=74 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:41.618882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:41.619403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:41.620121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:41.620553 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:41.646707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b7ca8891-1734-48a3-9654-af00eade8b75 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/ips" status: 200 len: 150 microversion: 2.1 time: 0.044424 Jul 01 20:01:41.647259 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 460/925] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 20:01:41 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:42.966687 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=50 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:42.967415 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=88 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:01:42.971720 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b4dbe9c-c913-463b-b39d-7deb0e67dd66"}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:42.972852 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:42.980497 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:42.980942 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:42.981728 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:42.982163 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:43.225225 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-0d02c7f7-5a1e-48c1-9f25-b171f27086f1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259264 Jul 01 20:01:43.225861 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 466/926] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 20:01:42 2022] POST /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:50.714302 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b4dbe9c-c913-463b-b39d-7deb0e67dd66"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:50.715407 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:50.721888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.722331 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.723106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.723535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.801022 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Invalid volume: volume 6b4dbe9c-c913-463b-b39d-7deb0e67dd66 is already attached to instances: 7ac04816-f371-4f1f-a486-111e39d68532 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: POST /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments HTTP/1.1 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 74 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:01:50.803556 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {"volumeAttachment": {"volumeId": "6b4dbe9c-c913-463b-b39d-7deb0e67dd66"}} Jul 01 20:01:50.805238 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Invalid volume: volume 6b4dbe9c-c913-463b-b39d-7deb0e67dd66 is already attached to instances: 7ac04816-f371-4f1f-a486-111e39d68532 Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'server_id': '7ac04816-f371-4f1f-a486-111e39d68532', 'body': {'volumeAttachment': {'volumeId': '6b4dbe9c-c913-463b-b39d-7deb0e67dd66'}}} Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6b4dbe9c-c913-463b-b39d-7deb0e67dd66 is already attached to instances: 7ac04816-f371-4f1f-a486-111e39d68532 Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:50.806082 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6b4dbe9c-c913-463b-b39d-7deb0e67dd66 is already attached to instances: 7ac04816-f371-4f1f-a486-111e39d68532 Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:50.807294 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6b4dbe9c-c913-463b-b39d-7deb0e67dd66 is already attached to instances: 7ac04816-f371-4f1f-a486-111e39d68532 Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 400 to user: Invalid volume: volume 6b4dbe9c-c913-463b-b39d-7deb0e67dd66 is already attached to instances: 7ac04816-f371-4f1f-a486-111e39d68532 {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-75cedf3a-0bb7-4376-8178-a9808f25156f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094620 Jul 01 20:01:50.808512 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 461/927] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 20:01:50 2022] POST /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 01 20:01:50.866099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:50.866723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:50.872909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.873356 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.874137 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:50.874573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:50.961039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'services' on Instance uuid 7ac04816-f371-4f1f-a486-111e39d68532 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:01:51.031512 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-168b9471-4e93-415c-bee6-9cb8f30afb30 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments/6b4dbe9c-c913-463b-b39d-7deb0e67dd66" status: 202 len: 0 microversion: 2.1 time: 0.170641 Jul 01 20:01:51.032088 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 467/928] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 20:01:50 2022] DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments/6b4dbe9c-c913-463b-b39d-7deb0e67dd66 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:01:51.040676 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:51.041690 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:51.047992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.048568 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.049348 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:51.049816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:51.084763 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9b2959d3-64b6-489c-8216-fc68d5b57b1e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048350 Jul 01 20:01:51.085313 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 462/929] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:01:51 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:52.097403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:52.098495 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:52.104829 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:52.105281 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:52.106123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:52.106562 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:52.135560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c6c133af-99b6-4e0a-92c9-40436a5b38a6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042940 Jul 01 20:01:52.136142 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 468/930] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:01:52 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 20:01:52.195427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:52.195977 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:52.203210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:52.203647 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:52.204409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:52.204843 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:52.234998 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:01:52.313222 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ce2aba33-ebda-4c2c-974a-8ca39241ae90 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 204 len: 0 microversion: 2.1 time: 0.121924 Jul 01 20:01:52.314000 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 463/931] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:01:52 2022] DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 01 20:01:52.322516 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:52.323113 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:52.329093 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:52.329628 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:52.330451 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:52.330954 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:52.491417 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:52.499124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ed0ae231-04da-4e4e-907c-b4041fa9a190 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1683 microversion: 2.1 time: 0.181000 Jul 01 20:01:52.499696 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 469/932] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:52 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:53.517094 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:53.518019 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:53.524688 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:53.525143 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:53.525950 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:53.526397 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:53.664751 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:53.672224 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-95605aaf-057b-4ee2-996f-b62eb41de978 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1683 microversion: 2.1 time: 0.159716 Jul 01 20:01:53.673033 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 464/933] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:53 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:54.690098 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:54.690712 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:54.697648 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:54.698099 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:54.698862 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:54.699294 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:54.957028 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:54.965893 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e7816033-46b4-4127-bd51-7d51481d3c52 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1683 microversion: 2.1 time: 0.279180 Jul 01 20:01:54.976107 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 470/934] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:54 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1683 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:55.158488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-81251f02-3a3b-45ff-a00d-c3731177b735 req-4ae5483f-eb6c-4db0-a2c1-4ea4ec505cb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ac04816-f371-4f1f-a486-111e39d68532", "name": "network-vif-deleted", "tag": "14c3c357-d038-4761-af70-e6a46b8da1d3"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:01:55.175286 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-81251f02-3a3b-45ff-a00d-c3731177b735 req-4ae5483f-eb6c-4db0-a2c1-4ea4ec505cb8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:55.175731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-81251f02-3a3b-45ff-a00d-c3731177b735 req-4ae5483f-eb6c-4db0-a2c1-4ea4ec505cb8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:55.189203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-81251f02-3a3b-45ff-a00d-c3731177b735 req-4ae5483f-eb6c-4db0-a2c1-4ea4ec505cb8 service nova] Creating event network-vif-deleted:14c3c357-d038-4761-af70-e6a46b8da1d3 for instance 7ac04816-f371-4f1f-a486-111e39d68532 on hv-cinder-84460 Jul 01 20:01:55.195589 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-81251f02-3a3b-45ff-a00d-c3731177b735 req-4ae5483f-eb6c-4db0-a2c1-4ea4ec505cb8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040651 Jul 01 20:01:55.196203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 465/935] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:01:55.984300 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:55.984916 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:55.992351 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:55.992797 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:55.993569 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:55.994033 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:56.026042 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:56.026518 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:56.026969 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'fault' on Instance uuid 7ac04816-f371-4f1f-a486-111e39d68532 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:01:56.069348 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:56.077037 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9bd77cb7-79cc-4aec-a752-d4b789c16cd8 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1332 microversion: 2.1 time: 0.096536 Jul 01 20:01:56.077640 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 471/936] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:55 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:57.095198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:57.095899 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:57.103198 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:57.103647 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:57.104409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:57.104848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:57.139103 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:57.139489 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:57.139938 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'fault' on Instance uuid 7ac04816-f371-4f1f-a486-111e39d68532 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:01:57.184674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:57.192192 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d23d11d3-7756-44d5-817d-7d1d75695b1f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1332 microversion: 2.1 time: 0.101326 Jul 01 20:01:57.192771 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 466/937] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:57 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:01:58.210490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:58.211379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:58.217863 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:58.218429 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:58.219939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:58.221501 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:58.264886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:58.265338 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:58.265939 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'fault' on Instance uuid 7ac04816-f371-4f1f-a486-111e39d68532 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:01:58.318226 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:01:58.325141 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bffbbbbe-4e39-4934-a322-f7b6414b0f9a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 200 len: 1332 microversion: 2.1 time: 0.119360 Jul 01 20:01:58.325725 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 472/938] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:58 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:01:59.342767 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:59.343392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:01:59.350335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:59.350783 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:59.351554 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:01:59.351990 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:01:59.366084 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 HTTP/1.1 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:01:59.367723 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:01:59.369373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '7ac04816-f371-4f1f-a486-111e39d68532'} Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:01:59.370321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:01:59.371801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:01:59.373153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:01:59.373153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c4029e82-ce36-42cd-a905-33c654f42fce tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 404 len: 111 microversion: 2.1 time: 0.030497 Jul 01 20:01:59.373153 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 467/939] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:01:59 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:01:59.378779 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a72fb47b-073f-48b6-802e-cee69bb0658d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '.version_select at 0x7fa0075e8e50>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:01:59.397482 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a72fb47b-073f-48b6-802e-cee69bb0658d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012609850" status: 202 len: 0 microversion: 2.1 time: 0.023176 Jul 01 20:01:59.398304 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 473/940] 10.222.0.66 () {58 vars in 1220 bytes} [Fri Jul 1 20:01:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2012609850 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:02:00.020113 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-819daeaa-fc07-4565-b249-b909ae622cc2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: .version_select at 0x7fa007769790>, body: {"keypair": {"name": "tempest-keypair-137834325", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAcQ2+2eFbH/IfjQVeEWJiX4RoBKzkZh3PU34wCtUQMxLcdh7Pb3s2s2C2zzwZ1zpy+ry9+0kwiLcxTmSRgAx7+/t3SEEIJtW3ZNrTqx4bMZmDSl7E1Egrz64b0yoznp2A=="}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:00.034531 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-819daeaa-fc07-4565-b249-b909ae622cc2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:02:00.038977 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.quota [None req-819daeaa-fc07-4565-b249-b909ae622cc2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'key_pairs'} {{(pid=124286) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:02:00.059944 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-819daeaa-fc07-4565-b249-b909ae622cc2 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043931 Jul 01 20:02:00.060523 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 468/941] 10.222.0.66 () {60 vars in 1158 bytes} [Fri Jul 1 20:02:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:01.356580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1682588108", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd301699-ca40-48e9-9559-67a73cd4bb19"}], "security_groups": [{"name": "tempest-securitygroup--17478877"}], "key_name": "tempest-keypair-137834325", "user_data": "}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:01.455709 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] validate_networks() for [('bd301699-ca40-48e9-9559-67a73cd4bb19', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 20:02:01.832725 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 20:02:01.833152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 20:02:01.834292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 20:02:01.834844 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 20:02:01.835237 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 20:02:01.844117 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:01.844574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:01.845374 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:01.845881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:01.863695 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:02:01.867784 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Getting quotas for user 8f2b9a6934d34f58a09a4cefb154371c and project 983da191c3d44e608e40f289e26d3603. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:02:01.879282 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 20:02:01.882000 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 20:02:01.929958 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1eb40080-4f8b-4f82-ba87-eb74f0379d57 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.577988 Jul 01 20:02:01.930513 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 474/942] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 20:02:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 20:02:01.940976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-226f0be4-2284-4e2b-8d31-289a776e9063 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:01.941604 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-226f0be4-2284-4e2b-8d31-289a776e9063 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:01.996241 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-226f0be4-2284-4e2b-8d31-289a776e9063 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:02.003848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-226f0be4-2284-4e2b-8d31-289a776e9063 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1241 microversion: 2.1 time: 0.067186 Jul 01 20:02:02.004403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 469/943] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:01 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:03.022892 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:03.023670 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:03.034475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:03.034936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:03.035715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:03.036317 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:03.100287 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:03.107650 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9fc5f496-30b1-4c2c-b7aa-460d472700b9 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1299 microversion: 2.1 time: 0.089249 Jul 01 20:02:03.108213 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 475/944] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:03 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:04.124607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:04.125483 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:04.135216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:04.140602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:04.142032 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:04.142715 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:04.346408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:04.354950 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-4d9c001c-20f5-4fb5-bd70-f00d910c7487 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.234182 Jul 01 20:02:04.355660 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 470/945] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:04 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:04.458390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-9b63924a-2ae0-4dde-9d74-dc6c8c45016c req-e90a63ba-54af-425f-9db9-f3a576360d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1198a30a-c872-4ac1-80ed-72d9337ef1f2", "tag": "f8ba3faa-bb9f-4e87-9517-1f7a10717629"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:04.469229 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9b63924a-2ae0-4dde-9d74-dc6c8c45016c req-e90a63ba-54af-425f-9db9-f3a576360d2b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:04.469911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-9b63924a-2ae0-4dde-9d74-dc6c8c45016c req-e90a63ba-54af-425f-9db9-f3a576360d2b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:04.497022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-9b63924a-2ae0-4dde-9d74-dc6c8c45016c req-e90a63ba-54af-425f-9db9-f3a576360d2b service nova] Creating event network-changed:f8ba3faa-bb9f-4e87-9517-1f7a10717629 for instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 on hv-cinder-84460 Jul 01 20:02:04.502943 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-9b63924a-2ae0-4dde-9d74-dc6c8c45016c req-e90a63ba-54af-425f-9db9-f3a576360d2b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057807 Jul 01 20:02:04.504379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 476/946] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:05.372774 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:05.373734 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:05.382028 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:05.382484 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:05.383250 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:05.383683 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:05.521399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:05.528840 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-959d0cbc-f10c-4dde-88d2-4b0be8feb1d7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.160295 Jul 01 20:02:05.529464 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 471/947] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:05 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:06.547122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:06.548528 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:06.557191 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:06.557926 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:06.559033 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:06.559707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:06.700252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:06.708109 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9a69b0b9-0304-48c9-bf74-fbdd2dc5bf66 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.165276 Jul 01 20:02:06.709555 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 477/948] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:06 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:07.727118 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:07.727740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:07.734832 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:07.735282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:07.736045 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:07.736485 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:07.871831 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:07.879267 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fbd188ae-435e-4c6a-8a75-71b2b9acc2b6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.157363 Jul 01 20:02:07.879867 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 472/949] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:07 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:08.068804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1336355125", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "networks": [{"uuid": "cb46ba7b-648e-4780-990c-7464d8fd9433"}]}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:08.119475 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] validate_networks() for [('cb46ba7b-648e-4780-990c-7464d8fd9433', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 20:02:08.460321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 20:02:08.460750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 20:02:08.461259 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 20:02:08.461708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 20:02:08.462130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 20:02:08.471270 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:08.471718 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:08.472525 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:08.472964 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:08.490460 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Getting quotas for project 8fc7896ac2f04a87bbe1e19b92c87fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:02:08.494427 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Getting quotas for user 48d92050460c411997ab955ff07dc3cd and project 8fc7896ac2f04a87bbe1e19b92c87fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:02:08.505950 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 20:02:08.508290 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 20:02:08.553799 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-492756f5-738f-4518-b51e-5069ae9e8eee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.489511 Jul 01 20:02:08.554446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 478/950] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 20:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 491 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 20:02:08.565140 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c842998e-dd96-4a26-ab14-8cff6929c257 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:08.565786 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c842998e-dd96-4a26-ab14-8cff6929c257 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:08.624463 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c842998e-dd96-4a26-ab14-8cff6929c257 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:08.631473 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c842998e-dd96-4a26-ab14-8cff6929c257 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1219 microversion: 2.1 time: 0.070740 Jul 01 20:02:08.632042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 473/951] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:08 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:08.897194 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:08.897842 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:08.904677 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:08.905133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:08.905938 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:08.906384 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:09.038723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:09.046299 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-ab03f975-5879-4265-a8a9-af22e35ed1c7 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.153667 Jul 01 20:02:09.046865 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 479/952] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:08 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:09.569216 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-4c6fb319-7d7b-40fd-9eed-b3a72841b6bb req-73253de8-18bd-4533-a2bb-40d494181ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1198a30a-c872-4ac1-80ed-72d9337ef1f2", "name": "network-vif-plugged", "status": "completed", "tag": "f8ba3faa-bb9f-4e87-9517-1f7a10717629"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:09.585383 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4c6fb319-7d7b-40fd-9eed-b3a72841b6bb req-73253de8-18bd-4533-a2bb-40d494181ea6 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:09.586488 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-4c6fb319-7d7b-40fd-9eed-b3a72841b6bb req-73253de8-18bd-4533-a2bb-40d494181ea6 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:09.603593 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-4c6fb319-7d7b-40fd-9eed-b3a72841b6bb req-73253de8-18bd-4533-a2bb-40d494181ea6 service nova] Creating event network-vif-plugged:f8ba3faa-bb9f-4e87-9517-1f7a10717629 for instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 on hv-cinder-84460 Jul 01 20:02:09.608984 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-4c6fb319-7d7b-40fd-9eed-b3a72841b6bb req-73253de8-18bd-4533-a2bb-40d494181ea6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044500 Jul 01 20:02:09.609703 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 474/953] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:09.650409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:09.651170 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:09.658641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:09.659125 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:09.659985 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:09.660539 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:09.736708 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:09.745248 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-57e702a1-6a9d-4012-934e-15cd5b75880d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1277 microversion: 2.1 time: 0.100060 Jul 01 20:02:09.746005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 480/954] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:09 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:02:10.064443 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:10.065174 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:10.072535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:10.072992 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:10.073779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:10.074219 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:10.310584 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:10.320318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fc672272-0fc2-46a2-a960-786ee8d1f842 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.260165 Jul 01 20:02:10.321068 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 475/955] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:10 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:10.761838 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:10.762446 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:10.769214 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:10.769691 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:10.770456 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:10.771392 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:10.978601 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:10.985832 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3a9c846d-c69c-46cc-8858-f3d08a76f3f1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.227952 Jul 01 20:02:10.986373 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 481/956] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:10 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:11.322745 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-82e016dc-0b30-4306-8638-7b09b0ff0ba1 req-7c60ac70-4a96-476d-b2fc-11aa0e4e0bd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19f4d457-7b70-4b7f-ba60-1507361056bc", "tag": "7cd64257-fc0d-4ce7-8ae6-956d17f483df"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:11.336987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:11.337609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:11.338204 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-82e016dc-0b30-4306-8638-7b09b0ff0ba1 req-7c60ac70-4a96-476d-b2fc-11aa0e4e0bd5 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:11.338818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-82e016dc-0b30-4306-8638-7b09b0ff0ba1 req-7c60ac70-4a96-476d-b2fc-11aa0e4e0bd5 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:11.351771 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:11.352214 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:11.352435 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-82e016dc-0b30-4306-8638-7b09b0ff0ba1 req-7c60ac70-4a96-476d-b2fc-11aa0e4e0bd5 service nova] Creating event network-changed:7cd64257-fc0d-4ce7-8ae6-956d17f483df for instance 19f4d457-7b70-4b7f-ba60-1507361056bc on hv-cinder-84460 Jul 01 20:02:11.352983 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:11.353409 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:11.357047 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-82e016dc-0b30-4306-8638-7b09b0ff0ba1 req-7c60ac70-4a96-476d-b2fc-11aa0e4e0bd5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039085 Jul 01 20:02:11.357688 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 476/957] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:11.586115 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:11.589673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:11.594556 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a28fac0f-77db-49f6-af41-86b9156f7922 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1365 microversion: 2.1 time: 0.261714 Jul 01 20:02:11.595321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 482/958] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:11 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1365 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:12.003299 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:12.003916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:12.006669 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:12.012408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:12.012870 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:12.013662 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:12.014339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:12.019270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:12.151969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:12.159340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-eb228295-c41e-4f1e-820d-d4161cfd4383 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.160429 Jul 01 20:02:12.159905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 477/959] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:11 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:12.612201 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:12.613379 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:12.621736 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:12.622233 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:12.623015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:12.623465 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:12.861097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:12.868991 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-1a7bccb9-e19a-4318-9bfe-b4fd5ab16c35 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1556 microversion: 2.1 time: 0.260540 Jul 01 20:02:12.869572 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 483/960] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:12 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1556 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:12.885420 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:12.886010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:12.892825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:12.893272 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:12.894063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:12.894496 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:13.012462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-862334e0-0473-421c-91df-8713bdf7441e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130944 Jul 01 20:02:13.017945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 478/961] 10.222.0.66 () {58 vars in 1274 bytes} [Fri Jul 1 20:02:12 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:13.176046 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:13.176914 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:13.179742 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:13.186221 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:13.186924 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:13.188022 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:13.188574 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:13.325256 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:13.332733 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-604a220a-367f-47ba-bf10-b636f577d457 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.160737 Jul 01 20:02:13.333292 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 484/962] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:13 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:13.925625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-dd10268c-0df9-4793-8705-44dad15e54eb req-8b51b986-8a57-4776-ac6d-7a9758a627a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1198a30a-c872-4ac1-80ed-72d9337ef1f2", "tag": "f8ba3faa-bb9f-4e87-9517-1f7a10717629"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:13.935203 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-dd10268c-0df9-4793-8705-44dad15e54eb req-8b51b986-8a57-4776-ac6d-7a9758a627a8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:13.935719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-dd10268c-0df9-4793-8705-44dad15e54eb req-8b51b986-8a57-4776-ac6d-7a9758a627a8 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:13.947382 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-dd10268c-0df9-4793-8705-44dad15e54eb req-8b51b986-8a57-4776-ac6d-7a9758a627a8 service nova] Creating event network-changed:f8ba3faa-bb9f-4e87-9517-1f7a10717629 for instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 on hv-cinder-84460 Jul 01 20:02:13.952211 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-dd10268c-0df9-4793-8705-44dad15e54eb req-8b51b986-8a57-4776-ac6d-7a9758a627a8 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 Jul 01 20:02:13.952963 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 479/963] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:14.350803 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:14.352129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:14.363573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:14.364298 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:14.366577 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:14.367038 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:14.554940 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:14.562698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-12ffd191-0f7a-42bc-96fc-b46997391141 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.216902 Jul 01 20:02:14.563262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 485/964] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:14 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:15.581139 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:15.581861 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:15.589340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:15.589809 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:15.590775 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:15.591366 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:15.727836 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:15.735219 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-053af91a-4956-4cae-bfd0-61be29c3ffb1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.158855 Jul 01 20:02:15.735807 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 480/965] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:15 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:16.752325 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:16.752864 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:16.759671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:16.760124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:16.760892 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:16.761333 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:16.891990 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:16.899984 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8d0a0ae2-e301-41db-8e1d-d373499cca33 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.151669 Jul 01 20:02:16.900533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 486/966] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:16 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:17.600360 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-b10cf3c7-186a-463e-8f1e-196e2efdba51 req-d15db28b-3ebc-4213-aa7f-adb591ce0f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f4d457-7b70-4b7f-ba60-1507361056bc", "name": "network-vif-plugged", "status": "completed", "tag": "7cd64257-fc0d-4ce7-8ae6-956d17f483df"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:17.609065 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b10cf3c7-186a-463e-8f1e-196e2efdba51 req-d15db28b-3ebc-4213-aa7f-adb591ce0f0b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:17.609565 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-b10cf3c7-186a-463e-8f1e-196e2efdba51 req-d15db28b-3ebc-4213-aa7f-adb591ce0f0b service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:17.621637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-b10cf3c7-186a-463e-8f1e-196e2efdba51 req-d15db28b-3ebc-4213-aa7f-adb591ce0f0b service nova] Creating event network-vif-plugged:7cd64257-fc0d-4ce7-8ae6-956d17f483df for instance 19f4d457-7b70-4b7f-ba60-1507361056bc on hv-cinder-84460 Jul 01 20:02:17.626399 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-b10cf3c7-186a-463e-8f1e-196e2efdba51 req-d15db28b-3ebc-4213-aa7f-adb591ce0f0b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029720 Jul 01 20:02:17.627180 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 481/967] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:17.917228 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:17.917867 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:17.924373 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:17.924818 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:17.925654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:17.926036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:18.057997 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:18.065253 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-fe4096c2-96ca-4715-a330-888f1ffa4f45 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.151883 Jul 01 20:02:18.065858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 487/968] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:17 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:02:19.079308 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=8 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:19.083637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:19.084340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:19.090901 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:19.091347 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:19.092100 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:19.092534 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:19.230739 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:19.238229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f2cfcc26-f08e-4146-b09b-13d5afa96b64 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1319 microversion: 2.1 time: 0.160314 Jul 01 20:02:19.238806 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 482/969] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:19 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:20.256171 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:20.256833 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:20.258901 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=4 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:20.259688 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=12 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:20.266494 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:20.266944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:20.267707 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:20.268152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:20.400084 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:20.407563 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-05e28ac2-fc79-47a1-9663-35e4161e8af6 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1508 microversion: 2.1 time: 0.155828 Jul 01 20:02:20.408124 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 488/970] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:20 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:37.620322 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "595f8226-3b3c-4f1f-a26b-03d4f1a03304", "device": "/dev/sdb"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:37.622002 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:37.624433 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=11 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:37.625142 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=25 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:37.631102 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:37.631555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:37.632825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:37.633261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:37.871193 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-7c003d3f-4e13-4978-8c37-ddd7a1f4a1f2 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "POST /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254543 Jul 01 20:02:37.871802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 483/971] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 20:02:37 2022] POST /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:02:44.420120 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:44.420857 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:44.423926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-8c66e18e-3786-42e6-a1ad-37a50eacf8d2 req-94bffaa9-9879-4575-890a-b243e4dafaf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc669e16-66da-4c61-bfae-4d266c6b16d8", "tag": "6adc29b3-1960-40fd-8ad1-4dfc34d21261"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:44.427181 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=9 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:44.427987 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=36 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:02:44.431662 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:44.432181 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:44.432968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:44.433404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:44.434329 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-8c66e18e-3786-42e6-a1ad-37a50eacf8d2 req-94bffaa9-9879-4575-890a-b243e4dafaf4 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:44.434847 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-8c66e18e-3786-42e6-a1ad-37a50eacf8d2 req-94bffaa9-9879-4575-890a-b243e4dafaf4 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:44.446655 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-8c66e18e-3786-42e6-a1ad-37a50eacf8d2 req-94bffaa9-9879-4575-890a-b243e4dafaf4 service nova] Creating event network-changed:6adc29b3-1960-40fd-8ad1-4dfc34d21261 for instance cc669e16-66da-4c61-bfae-4d266c6b16d8 on hv-cinder-84460 Jul 01 20:02:44.451801 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-8c66e18e-3786-42e6-a1ad-37a50eacf8d2 req-94bffaa9-9879-4575-890a-b243e4dafaf4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032677 Jul 01 20:02:44.452575 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 484/972] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:44.461614 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:02:44.553820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-beee2f95-a1b8-4181-8067-9ce68a6a3c2e tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "DELETE /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 204 len: 0 microversion: 2.1 time: 0.137577 Jul 01 20:02:44.557928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 489/973] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:02:44 2022] DELETE /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:02:44.565146 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:44.565891 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:44.572754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:44.573200 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:44.574019 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:44.574492 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:44.838578 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:44.846121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-316a58c7-9b3f-4816-ae9f-0a7e076672f4 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1577 microversion: 2.1 time: 0.286523 Jul 01 20:02:44.846683 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 485/974] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:44 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1577 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:45.864407 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:45.865112 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:45.872346 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:45.872795 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:45.873560 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:45.874020 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:46.053148 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:46.061387 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3b991fae-0bb6-4da8-9209-29e4944c6494 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1577 microversion: 2.1 time: 0.201260 Jul 01 20:02:46.061985 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 490/975] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:45 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1577 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:47.078557 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:47.079167 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:47.085891 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:47.086346 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:47.087137 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:47.087578 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:47.222333 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:47.230335 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-793958dd-3122-4a63-bb8e-7c33b23de37d tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1577 microversion: 2.1 time: 0.155641 Jul 01 20:02:47.230896 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 486/976] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:47 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:48.247565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:48.248154 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:48.254605 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:48.255051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:48.255804 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:48.256238 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:48.387036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:48.394723 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9e3c400d-f0f2-4237-abb9-09b941efaa76 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1577 microversion: 2.1 time: 0.151082 Jul 01 20:02:48.395287 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 491/977] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:48 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:49.411938 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:49.412568 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:49.420270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:49.420714 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:49.421460 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:49.421916 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:49.568324 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:49.576600 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d0be3b67-1080-41aa-8153-1f55623a7db5 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1577 microversion: 2.1 time: 0.168571 Jul 01 20:02:49.577173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 487/978] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:49 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:50.593886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:50.594633 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:50.600834 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:50.601936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:50.602704 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:50.603142 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:50.784057 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:50.792565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a6044c56-48d9-4431-baf7-67f96013be22 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1577 microversion: 2.1 time: 0.202823 Jul 01 20:02:50.793127 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 492/979] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:50 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1577 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:02:51.663461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-34b5e118-595c-4c94-9660-da9646b486fb req-24e6d7cc-12f7-4fdc-a027-3cc08ad026e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc669e16-66da-4c61-bfae-4d266c6b16d8", "name": "network-vif-deleted", "tag": "6adc29b3-1960-40fd-8ad1-4dfc34d21261"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:51.677447 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-34b5e118-595c-4c94-9660-da9646b486fb req-24e6d7cc-12f7-4fdc-a027-3cc08ad026e0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:51.678027 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-34b5e118-595c-4c94-9660-da9646b486fb req-24e6d7cc-12f7-4fdc-a027-3cc08ad026e0 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:51.692535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-34b5e118-595c-4c94-9660-da9646b486fb req-24e6d7cc-12f7-4fdc-a027-3cc08ad026e0 service nova] Creating event network-vif-deleted:6adc29b3-1960-40fd-8ad1-4dfc34d21261 for instance cc669e16-66da-4c61-bfae-4d266c6b16d8 on hv-cinder-84460 Jul 01 20:02:51.697881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-34b5e118-595c-4c94-9660-da9646b486fb req-24e6d7cc-12f7-4fdc-a027-3cc08ad026e0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038537 Jul 01 20:02:51.698653 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 488/980] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:51.767056 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:51.767613 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:51.774901 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:51.775350 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:51.776121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:51.776570 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:51.799805 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bbf87ba4-e7ed-4574-9379-e0d9395be8e6 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/ips" status: 200 len: 151 microversion: 2.1 time: 0.036831 Jul 01 20:02:51.800411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 493/981] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 20:02:51 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:51.811479 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:51.812538 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:51.818741 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:51.819182 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:51.820912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:51.821510 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:51.902063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:51.911307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-bc77a21b-0c34-4ac9-bdab-29828c695af0 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1225 microversion: 2.1 time: 0.104346 Jul 01 20:02:51.912686 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 489/982] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:51 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:52.929069 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:52.929754 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:52.936347 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:52.936793 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:52.937550 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:52.938015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:52.973232 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:52.973710 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:52.974161 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lazy-loading 'fault' on Instance uuid cc669e16-66da-4c61-bfae-4d266c6b16d8 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:02:53.016079 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:53.024015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bc3f671e-d272-4c7d-bfd7-d7548347dc36 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1230 microversion: 2.1 time: 0.098716 Jul 01 20:02:53.024621 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 494/983] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:52 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:54.041486 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:54.042237 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:54.048635 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:54.049085 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:54.049880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:54.050321 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:54.081070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:54.081520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:54.082001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lazy-loading 'fault' on Instance uuid cc669e16-66da-4c61-bfae-4d266c6b16d8 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:02:54.124991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:02:54.132478 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-35f5b339-edad-4a92-ad38-e81050c48c7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 200 len: 1230 microversion: 2.1 time: 0.095324 Jul 01 20:02:54.133199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 490/984] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:54 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:02:55.148990 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:02:55.150043 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: cc669e16-66da-4c61-bfae-4d266c6b16d8] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:55.156586 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:55.157027 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:55.157808 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:55.158241 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:55.171853 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] HTTP exception thrown: Instance cc669e16-66da-4c61-bfae-4d266c6b16d8 could not be found. Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Request method failure captured: Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 HTTP/1.1 Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1EKpGqGuDTTZLLwHN1F-N7z6D3quDIc6jsgV8eMHYFdI1hANAEpa3SIM1cDzIxEbRTbM08rgfm0Xt7Y80U4NEe-bplO5IUbxXQOl59bfyaYm2Eu4PCikqMHeX-A5jO-pm7rrKDvsEMmZnhi50jmofKdbU-eouzn0kz0vCJpHKI52qs Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:02:55.173450 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-TestVolumeBootPattern-930842922 Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 80267c31f3fc4b3fbc8dc7ed03326eeb Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance cc669e16-66da-4c61-bfae-4d266c6b16d8 could not be found. Jul 01 20:02:55.175160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'cc669e16-66da-4c61-bfae-4d266c6b16d8'} Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc669e16-66da-4c61-bfae-4d266c6b16d8 could not be found. Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:02:55.176118 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc669e16-66da-4c61-bfae-4d266c6b16d8 could not be found. Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc669e16-66da-4c61-bfae-4d266c6b16d8 could not be found. Jul 01 20:02:55.177716 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:02:55.179385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Returning 404 to user: Instance cc669e16-66da-4c61-bfae-4d266c6b16d8 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:02:55.179385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2c63ce62-30d7-4e8d-9dde-af6207b98659 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8" status: 404 len: 111 microversion: 2.1 time: 0.029942 Jul 01 20:02:55.179385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 495/985] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:02:55 2022] GET /compute/v2.1/servers/cc669e16-66da-4c61-bfae-4d266c6b16d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:02:56.378687 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e43fca0-fee5-4d76-bdfe-c5d3227692b2"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:02:56.379746 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:02:56.387014 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:56.387524 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:56.388280 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:02:56.388706 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:02:57.532641 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c50b184e-e45f-4ea7-8a86-ac27c66655a1 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "POST /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.157687 Jul 01 20:02:57.533336 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 491/986] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 20:02:56 2022] POST /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments => generated 194 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:02:57.944173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:02:57.944436 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Fri Jul 1 20:02:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:03:01.338049 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:01.338595 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:01.340973 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-9bd44828-fc6a-41c2-b03a-9fad200be568 req-8d69906c-c1ba-4abc-9133-489450a19c59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c2262f-a173-4336-91b1-f5f7a20bf96d", "tag": "c3aa88b7-7e29-46f3-9c4e-3618ea05e754"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:01.347432 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:01.347954 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:01.348666 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:01.349105 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:01.350358 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9bd44828-fc6a-41c2-b03a-9fad200be568 req-8d69906c-c1ba-4abc-9133-489450a19c59 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:01.350873 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-9bd44828-fc6a-41c2-b03a-9fad200be568 req-8d69906c-c1ba-4abc-9133-489450a19c59 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:01.362114 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-9bd44828-fc6a-41c2-b03a-9fad200be568 req-8d69906c-c1ba-4abc-9133-489450a19c59 service nova] Creating event network-changed:c3aa88b7-7e29-46f3-9c4e-3618ea05e754 for instance 54c2262f-a173-4336-91b1-f5f7a20bf96d on hv-cinder-84460 Jul 01 20:03:01.367070 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-9bd44828-fc6a-41c2-b03a-9fad200be568 req-8d69906c-c1ba-4abc-9133-489450a19c59 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030951 Jul 01 20:03:01.368069 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 492/987] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:03:01.381259 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:03:01.459580 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-837fec95-2eeb-459a-8ca1-eed7be667b7f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "DELETE /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 204 len: 0 microversion: 2.1 time: 0.125775 Jul 01 20:03:01.460310 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 496/988] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:01 2022] DELETE /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:03:01.470560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:01.471269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:01.478444 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:01.478931 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:01.479845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:01.480284 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:01.639171 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:01.647865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9a29a933-e00f-4f2e-a0ac-deed7914586f tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1578 microversion: 2.1 time: 0.182177 Jul 01 20:03:01.648468 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 493/989] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:01 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:02.666332 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:02.666978 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:02.673434 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:02.673915 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:02.674686 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:02.675122 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:02.804187 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:02.811837 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-8595cf8f-ac0e-463d-bbd4-a08734aca38c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1578 microversion: 2.1 time: 0.150620 Jul 01 20:03:02.812395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 497/990] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:02 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:03.828865 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:03.829482 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:03.836063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:03.836514 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:03.837596 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:03.838038 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:03.973261 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:03.981612 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e4c9647f-fd6e-4411-86c8-b4243cc8b460 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1578 microversion: 2.1 time: 0.156579 Jul 01 20:03:03.982172 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 494/991] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:03 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:05.002558 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:05.003627 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:05.013006 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:05.013449 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:05.014240 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:05.014673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:05.166994 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:05.174353 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-a82fdbac-5744-4d82-b48f-73300f9539a6 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1578 microversion: 2.1 time: 0.178600 Jul 01 20:03:05.174917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 498/992] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:04 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:05.954729 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-bb59416f-45a2-4c78-85c2-bed0ac8efa0c req-cd847ee2-7ada-41b1-a345-2e153b5f03d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c2262f-a173-4336-91b1-f5f7a20bf96d", "name": "network-vif-deleted", "tag": "c3aa88b7-7e29-46f3-9c4e-3618ea05e754"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:05.965668 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-bb59416f-45a2-4c78-85c2-bed0ac8efa0c req-cd847ee2-7ada-41b1-a345-2e153b5f03d1 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:05.966121 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-bb59416f-45a2-4c78-85c2-bed0ac8efa0c req-cd847ee2-7ada-41b1-a345-2e153b5f03d1 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:05.979408 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-bb59416f-45a2-4c78-85c2-bed0ac8efa0c req-cd847ee2-7ada-41b1-a345-2e153b5f03d1 service nova] Creating event network-vif-deleted:c3aa88b7-7e29-46f3-9c4e-3618ea05e754 for instance 54c2262f-a173-4336-91b1-f5f7a20bf96d on hv-cinder-84460 Jul 01 20:03:05.984509 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-bb59416f-45a2-4c78-85c2-bed0ac8efa0c req-cd847ee2-7ada-41b1-a345-2e153b5f03d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034160 Jul 01 20:03:05.985573 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 495/993] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:06.199080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:06.199080 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:06.200320 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:06.200781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:06.201549 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:06.202019 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:06.204853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:06.205574 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:06.211740 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:06.212754 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:06.213529 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:06.214072 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:06.270013 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80267c31f3fc4b3fbc8dc7ed03326eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '262e5b1a6f6248cca455437d23b8d441', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:06.281765 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-52c044e4-25fa-42af-908a-dfee5c3de663 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 200 len: 1226 microversion: 2.1 time: 0.092189 Jul 01 20:03:06.282600 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 499/994] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:06 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:06.312560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'services' on Instance uuid 1198a30a-c872-4ac1-80ed-72d9337ef1f2 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:03:06.406148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-47ea704b-e0c2-47d8-8554-bfd52e21113f tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments/9e43fca0-fee5-4d76-bdfe-c5d3227692b2" status: 202 len: 0 microversion: 2.1 time: 0.205333 Jul 01 20:03:06.406745 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 496/995] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 20:03:06 2022] DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments/9e43fca0-fee5-4d76-bdfe-c5d3227692b2 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:03:06.415609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:06.416623 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:06.422770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:06.423221 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:06.423999 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:06.424428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:06.454431 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-058be8d1-2305-4dc2-b1f0-cce405482956 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Jul 01 20:03:06.454951 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 500/996] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:03:06 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:03:07.300640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.301101 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: 54c2262f-a173-4336-91b1-f5f7a20bf96d] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.307656 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.308225 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.308897 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.309269 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.322735 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] HTTP exception thrown: Instance 54c2262f-a173-4336-91b1-f5f7a20bf96d could not be found. Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Request method failure captured: Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d HTTP/1.1 Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1EKpGqGuDTTZLLwHN1F-N7z6D3quDIc6jsgV8eMHYFdI1hANAEpa3SIM1cDzIxEbRTbM08rgfm0Xt7Y80U4NEe-bplO5IUbxXQOl59bfyaYm2Eu4PCikqMHeX-A5jO-pm7rrKDvsEMmZnhi50jmofKdbU-eouzn0kz0vCJpHKI52qs Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:07.324362 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 80267c31f3fc4b3fbc8dc7ed03326eeb Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 54c2262f-a173-4336-91b1-f5f7a20bf96d could not be found. Jul 01 20:03:07.326043 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '54c2262f-a173-4336-91b1-f5f7a20bf96d'} Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c2262f-a173-4336-91b1-f5f7a20bf96d could not be found. Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:07.326971 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c2262f-a173-4336-91b1-f5f7a20bf96d could not be found. Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c2262f-a173-4336-91b1-f5f7a20bf96d could not be found. Jul 01 20:03:07.328535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.329951 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Returning 404 to user: Instance 54c2262f-a173-4336-91b1-f5f7a20bf96d could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:07.329951 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8ce39e2e-80e5-4b9a-ab4c-2fc747185738 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d" status: 404 len: 111 microversion: 2.1 time: 0.030124 Jul 01 20:03:07.329951 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 497/997] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:07 2022] GET /compute/v2.1/servers/54c2262f-a173-4336-91b1-f5f7a20bf96d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:07.467049 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.468152 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.474597 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.475051 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.475814 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.476249 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.504670 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-400710da-f19e-4841-9565-3f5e3f7997ac tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042361 Jul 01 20:03:07.505244 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 501/998] 10.222.0.66 () {58 vars in 1301 bytes} [Fri Jul 1 20:03:07 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 01 20:03:07.566213 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.566707 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.572674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.573122 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.573911 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.574349 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.599392 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Going to try to terminate instance {{(pid=124286) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:03:07.614281 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:07.663856 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=35 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:07.681991 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-2c480be5-dbf5-475e-be78-534f79a6ff36 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 204 len: 0 microversion: 2.1 time: 0.118351 Jul 01 20:03:07.682900 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 498/999] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:07 2022] DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:03:07.691660 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.692212 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.699025 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.699478 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.700243 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.700682 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.828270 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.828946 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.835111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.835640 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.836480 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.837042 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.852985 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] HTTP exception thrown: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Request method failure captured: Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: DELETE /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 HTTP/1.1 Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1EKpGqGuDTTZLLwHN1F-N7z6D3quDIc6jsgV8eMHYFdI1hANAEpa3SIM1cDzIxEbRTbM08rgfm0Xt7Y80U4NEe-bplO5IUbxXQOl59bfyaYm2Eu4PCikqMHeX-A5jO-pm7rrKDvsEMmZnhi50jmofKdbU-eouzn0kz0vCJpHKI52qs Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:07.854769 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 80267c31f3fc4b3fbc8dc7ed03326eeb Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.856432 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'abdbc8c7-9db6-4914-8ad4-b55ee6460761'} Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:07.860406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.862359 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.864974 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Returning 404 to user: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:07.864974 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ea80b485-54a3-4763-9b44-c0f0347c870c tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "DELETE /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 404 len: 111 microversion: 2.1 time: 0.032081 Jul 01 20:03:07.864974 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 499/1000] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:07 2022] DELETE /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 20:03:07.865423 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:07.865625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.865625 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] [instance: abdbc8c7-9db6-4914-8ad4-b55ee6460761] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.867609 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:07.872175 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.872621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.873254 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9d4ce77a-0d90-45bb-90bb-db0be72571bd tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1681 microversion: 2.1 time: 0.186022 Jul 01 20:03:07.873419 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.873826 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.874006 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 502/1001] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:07 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:07.888177 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] HTTP exception thrown: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Request method failure captured: Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 HTTP/1.1 Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1EKpGqGuDTTZLLwHN1F-N7z6D3quDIc6jsgV8eMHYFdI1hANAEpa3SIM1cDzIxEbRTbM08rgfm0Xt7Y80U4NEe-bplO5IUbxXQOl59bfyaYm2Eu4PCikqMHeX-A5jO-pm7rrKDvsEMmZnhi50jmofKdbU-eouzn0kz0vCJpHKI52qs Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:07.889776 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/262e5b1a6f6248cca455437d23b8d441"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 262e5b1a6f6248cca455437d23b8d441 Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-TestVolumeBootPattern-930842922 Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 80267c31f3fc4b3fbc8dc7ed03326eeb Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-TestVolumeBootPattern-930842922-project Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.891384 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'abdbc8c7-9db6-4914-8ad4-b55ee6460761'} Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:07.892287 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. Jul 01 20:03:07.894079 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:07.895379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Returning 404 to user: Instance abdbc8c7-9db6-4914-8ad4-b55ee6460761 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:07.895379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-8c25f266-3efe-4a3e-b04f-fa6ef24d2f11 tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761" status: 404 len: 111 microversion: 2.1 time: 0.030319 Jul 01 20:03:07.895379 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 500/1002] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:07 2022] GET /compute/v2.1/servers/abdbc8c7-9db6-4914-8ad4-b55ee6460761 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:07.957167 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:07.957699 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:07.966261 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.966715 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:07.967490 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:07.967929 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:08.053916 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lazy-loading 'services' on Instance uuid 19f4d457-7b70-4b7f-ba60-1507361056bc {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:03:08.126530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-169ad6ef-b929-46e0-8626-3cbe6cb99ad1 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "DELETE /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc/os-volume_attachments/595f8226-3b3c-4f1f-a26b-03d4f1a03304" status: 202 len: 0 microversion: 2.1 time: 0.173214 Jul 01 20:03:08.127184 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 503/1003] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 20:03:07 2022] DELETE /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc/os-volume_attachments/595f8226-3b3c-4f1f-a26b-03d4f1a03304 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:03:08.890637 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:08.891251 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:08.898296 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:08.898779 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:08.900029 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:08.900469 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:09.035229 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:09.043842 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-58c166a3-f1cc-429f-baed-4701de117d9e tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1681 microversion: 2.1 time: 0.157099 Jul 01 20:03:09.044601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 501/1004] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:08 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:09.191514 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-970fa19b-b11f-4356-9b50-e9c348c715ca tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] Calling method '.version_select at 0x7fa0074a7430>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:09.210730 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-970fa19b-b11f-4356-9b50-e9c348c715ca tempest-TestVolumeBootPattern-930842922 tempest-TestVolumeBootPattern-930842922-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1633635879" status: 202 len: 0 microversion: 2.1 time: 0.023407 Jul 01 20:03:09.211706 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 504/1005] 10.222.0.66 () {58 vars in 1262 bytes} [Fri Jul 1 20:03:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1633635879 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:03:10.063889 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:10.064686 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:10.072888 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.073478 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.074520 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.075110 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.197947 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:10.205881 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1d8c630c-bbf4-46be-ad11-ee325a83889a tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1615 microversion: 2.1 time: 0.146173 Jul 01 20:03:10.206462 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 502/1006] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:10 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1615 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:10.329883 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:10.330622 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:10.338579 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.339162 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.340034 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.340576 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.370652 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:03:10.413859 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-e1d4576b-4e54-43e6-85de-6f644f2b4ec7 req-de890dd5-9033-4846-b427-e9726e3fec2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1198a30a-c872-4ac1-80ed-72d9337ef1f2", "name": "network-vif-deleted", "tag": "f8ba3faa-bb9f-4e87-9517-1f7a10717629"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:10.438693 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-e1d4576b-4e54-43e6-85de-6f644f2b4ec7 req-de890dd5-9033-4846-b427-e9726e3fec2f service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.449266 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-e1d4576b-4e54-43e6-85de-6f644f2b4ec7 req-de890dd5-9033-4846-b427-e9726e3fec2f service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.471882 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-e1d4576b-4e54-43e6-85de-6f644f2b4ec7 req-de890dd5-9033-4846-b427-e9726e3fec2f service nova] Creating event network-vif-deleted:f8ba3faa-bb9f-4e87-9517-1f7a10717629 for instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 on hv-cinder-84460 Jul 01 20:03:10.486878 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-e1d4576b-4e54-43e6-85de-6f644f2b4ec7 req-de890dd5-9033-4846-b427-e9726e3fec2f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074947 Jul 01 20:03:10.487825 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 503/1007] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:10.535662 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-af8b997c-912b-4735-af1d-8f5af9359bd8 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "DELETE /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 204 len: 0 microversion: 2.1 time: 0.209499 Jul 01 20:03:10.537820 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 505/1008] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:10 2022] DELETE /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:03:10.549074 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:10.550120 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:10.563503 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.564303 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.565427 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:10.566314 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:10.747099 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:10.755810 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a93a7149-2d32-4474-844e-98e9be51cfc7 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1514 microversion: 2.1 time: 0.213114 Jul 01 20:03:10.756643 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 504/1009] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:10 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:11.227402 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:11.228856 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:11.235879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:11.236334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:11.237116 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:11.237553 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:11.278917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:11.279371 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:11.279830 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lazy-loading 'fault' on Instance uuid 1198a30a-c872-4ac1-80ed-72d9337ef1f2 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:03:11.358543 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f2b9a6934d34f58a09a4cefb154371c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983da191c3d44e608e40f289e26d3603', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:11.374055 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-4431d441-0542-4cf0-8cab-b361c05b6889 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 200 len: 1331 microversion: 2.1 time: 0.154032 Jul 01 20:03:11.374989 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 506/1010] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:11 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 1331 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:11.778200 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:11.779158 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:11.786130 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:11.786601 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:11.787372 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:11.787802 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:11.924530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:11.933498 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c624c76a-fd7d-4607-91fe-a84fc6a2649f tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1514 microversion: 2.1 time: 0.162857 Jul 01 20:03:11.934129 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 505/1011] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:11 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:12.393134 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:12.393796 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:12.401185 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:12.401667 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:12.402478 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:12.402913 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:12.417517 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 HTTP/1.1 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:03:12.419411 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:12.420817 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '1198a30a-c872-4ac1-80ed-72d9337ef1f2'} Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:12.421703 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:12.423021 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:12.424375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:12.424375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-441fdb8a-d698-4672-9f17-427ac9011f31 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 404 len: 111 microversion: 2.1 time: 0.032734 Jul 01 20:03:12.424375 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 507/1012] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:12 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 01 20:03:12.430116 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9920c015-1262-445a-aae1-4177fb3d6adb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '.version_select at 0x7fa0077daee0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:12.450304 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9920c015-1262-445a-aae1-4177fb3d6adb tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137834325" status: 202 len: 0 microversion: 2.1 time: 0.023990 Jul 01 20:03:12.454247 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 506/1013] 10.222.0.66 () {58 vars in 1217 bytes} [Fri Jul 1 20:03:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137834325 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:03:12.952792 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:12.954114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:12.963905 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:12.964848 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:12.965857 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:12.966481 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:13.201727 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-7d010c1c-eacf-419b-8524-dd6d22e3b1b4 req-e8719af2-6c11-4e68-aeec-4804be6ec00e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19f4d457-7b70-4b7f-ba60-1507361056bc", "name": "network-vif-deleted", "tag": "7cd64257-fc0d-4ce7-8ae6-956d17f483df"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:13.211725 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-7d010c1c-eacf-419b-8524-dd6d22e3b1b4 req-e8719af2-6c11-4e68-aeec-4804be6ec00e service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:13.213078 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-7d010c1c-eacf-419b-8524-dd6d22e3b1b4 req-e8719af2-6c11-4e68-aeec-4804be6ec00e service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:13.224035 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-7d010c1c-eacf-419b-8524-dd6d22e3b1b4 req-e8719af2-6c11-4e68-aeec-4804be6ec00e service nova] Creating event network-vif-deleted:7cd64257-fc0d-4ce7-8ae6-956d17f483df for instance 19f4d457-7b70-4b7f-ba60-1507361056bc on hv-cinder-84460 Jul 01 20:03:13.225403 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:13.231339 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-7d010c1c-eacf-419b-8524-dd6d22e3b1b4 req-e8719af2-6c11-4e68-aeec-4804be6ec00e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033147 Jul 01 20:03:13.232547 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 507/1014] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:13.234781 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-9a22ba84-9be0-4b34-919b-bc119372812e tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 200 len: 1514 microversion: 2.1 time: 0.286198 Jul 01 20:03:13.245100 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 508/1015] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:12 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:14.252986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:14.253912 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: 19f4d457-7b70-4b7f-ba60-1507361056bc] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:14.261406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:14.261941 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:14.262738 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:14.263178 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:14.281868 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] HTTP exception thrown: Instance 19f4d457-7b70-4b7f-ba60-1507361056bc could not be found. Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Request method failure captured: Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc HTTP/1.1 Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1K-Oez4MpboqUsmJs86oKqq5wgWcgMZdxvzPNqf_tojSaNn2IUDpAx_uaCwFmSEkF_1UpvhpsykT2YddVLDRILzLMTqT7r6IrqSTkfM5qkVzKIjLu_JxRrEKl2Do214v3KERLnOla1ZzQW68_PfXQwtKxV0IV4IUGDuzZHAjJvY55g Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 8fc7896ac2f04a87bbe1e19b92c87fc6 Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1135969710 Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:14.283602 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesSnapshotTestJSON-1135969710 Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 8fc7896ac2f04a87bbe1e19b92c87fc6 Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1135969710 Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesSnapshotTestJSON-1135969710-project Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 48d92050460c411997ab955ff07dc3cd Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesSnapshotTestJSON-1135969710-project Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 19f4d457-7b70-4b7f-ba60-1507361056bc could not be found. Jul 01 20:03:14.285307 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '19f4d457-7b70-4b7f-ba60-1507361056bc'} Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19f4d457-7b70-4b7f-ba60-1507361056bc could not be found. Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:14.286297 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19f4d457-7b70-4b7f-ba60-1507361056bc could not be found. Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19f4d457-7b70-4b7f-ba60-1507361056bc could not be found. Jul 01 20:03:14.287791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:14.289111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Returning 404 to user: Instance 19f4d457-7b70-4b7f-ba60-1507361056bc could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:14.289111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9359eb82-fb41-40d7-b0fc-3d3cf979cc29 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc" status: 404 len: 111 microversion: 2.1 time: 0.037007 Jul 01 20:03:14.289111 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 508/1016] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:14 2022] GET /compute/v2.1/servers/19f4d457-7b70-4b7f-ba60-1507361056bc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:15.186910 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:15.188002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:15.191500 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:15.195097 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:15.195544 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:15.196302 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:15.197385 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:15.211858 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 HTTP/1.1 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:03:15.214412 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.215773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '1198a30a-c872-4ac1-80ed-72d9337ef1f2'} Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:15.216654 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.218130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.220203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:15.220203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-326c7985-3dff-41da-9c46-24f16ca91503 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 404 len: 111 microversion: 2.1 time: 0.032922 Jul 01 20:03:15.220203 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 509/1017] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:15 2022] DELETE /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:15.224541 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:15.225152 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 1198a30a-c872-4ac1-80ed-72d9337ef1f2] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:15.232252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:15.232697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:15.233461 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:15.233926 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:15.250316 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 HTTP/1.1 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:15.251976 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.254136 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '1198a30a-c872-4ac1-80ed-72d9337ef1f2'} Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:15.255089 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. Jul 01 20:03:15.256555 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:15.257907 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance 1198a30a-c872-4ac1-80ed-72d9337ef1f2 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:15.257907 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c9cd0ee7-2549-4f2e-ab13-3fa35bb00b48 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2" status: 404 len: 111 microversion: 2.1 time: 0.035052 Jul 01 20:03:15.258616 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 509/1018] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:15 2022] GET /compute/v2.1/servers/1198a30a-c872-4ac1-80ed-72d9337ef1f2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:18.550692 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:18.551218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:18.559476 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.559926 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.560698 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.561129 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.575032 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 HTTP/1.1 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:03:18.576567 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.578200 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '7ac04816-f371-4f1f-a486-111e39d68532'} Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:18.579110 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.580659 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.582319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:18.582319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-616f6875-69e6-47fe-9270-b07baaccf5c3 tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 404 len: 111 microversion: 2.1 time: 0.031458 Jul 01 20:03:18.582319 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 510/1019] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:18 2022] DELETE /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:18.586409 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:18.587048 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: 7ac04816-f371-4f1f-a486-111e39d68532] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:18.593657 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.594095 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.594845 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.595273 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.608805 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 HTTP/1.1 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:18.610386 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.611905 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': '7ac04816-f371-4f1f-a486-111e39d68532'} Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:18.613039 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. Jul 01 20:03:18.614560 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.616257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance 7ac04816-f371-4f1f-a486-111e39d68532 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:18.616257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-f90d1362-cf97-47c3-b2b4-2e63cae35abe tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532" status: 404 len: 111 microversion: 2.1 time: 0.029197 Jul 01 20:03:18.616257 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 510/1020] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:18 2022] GET /compute/v2.1/servers/7ac04816-f371-4f1f-a486-111e39d68532 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:18.620926 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:18.621428 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:18.627503 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.627890 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.628647 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.629087 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.645197 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb HTTP/1.1 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:03:18.646731 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.648309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'c19da010-1763-4196-8876-e78433c1e0cb'} Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:18.649479 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.651160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.652812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:18.652812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b99ca73c-4d7c-44ed-9801-fb6cad4f940d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 404 len: 111 microversion: 2.1 time: 0.031806 Jul 01 20:03:18.652812 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 511/1021] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:18 2022] DELETE /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:18.656478 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:18.657112 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: c19da010-1763-4196-8876-e78433c1e0cb] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:18.663131 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.663569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.664316 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:18.664743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:18.678503 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb HTTP/1.1 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:18.679986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.682376 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'c19da010-1763-4196-8876-e78433c1e0cb'} Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:18.683373 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. Jul 01 20:03:18.684955 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:18.686452 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance c19da010-1763-4196-8876-e78433c1e0cb could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:18.686452 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-254186d9-c016-4975-b4e6-42717a32429c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb" status: 404 len: 111 microversion: 2.1 time: 0.029698 Jul 01 20:03:18.686452 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 511/1022] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:18 2022] GET /compute/v2.1/servers/c19da010-1763-4196-8876-e78433c1e0cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:20.003309 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:20.003813 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:20.010059 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:20.010511 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:20.011305 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:20.011743 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:20.025826 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 HTTP/1.1 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:03:20.027339 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: > Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.028911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': 'eb94df28-2151-48bf-9571-ae16d23c66a6'} Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:20.029909 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.031178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.032533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:20.032533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-eb5ff0dc-bf88-4040-88e1-a5efb0716d4d tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 404 len: 111 microversion: 2.1 time: 0.029236 Jul 01 20:03:20.032533 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 512/1023] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:19 2022] DELETE /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:20.036915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:20.037530 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] [instance: eb94df28-2151-48bf-9571-ae16d23c66a6] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:20.044788 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:20.045181 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:20.045969 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:20.046410 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:20.059784 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] HTTP exception thrown: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Request method failure captured: Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 HTTP/1.1 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1Hbit3d5MRZeIqPB9xL_jBxVb_X2HatG_IDVZNEmB7T9i20Lmi3iOCO8lqnD_4DFW-KFiB57TH8ZPNX17oLFMgkUy1Z04wmVC84mRBN5UWLsLdD9XzPVSMBcagapNyH5SjVvMHKkDqAEkDB4DIeZkscAfrx60KiknFpE_dAtg-ifU8 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:03:20.061292 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_983da191c3d44e608e40f289e26d3603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/983da191c3d44e608e40f289e26d3603"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/983da191c3d44e608e40f289e26d3603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 983da191c3d44e608e40f289e26d3603 Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-391204334 Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 8f2b9a6934d34f58a09a4cefb154371c Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-AttachVolumeNegativeTest-391204334-project Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.062996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'eb94df28-2151-48bf-9571-ae16d23c66a6'} Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:20.067252 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. Jul 01 20:03:20.069195 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:03:20.070579 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] Returning 404 to user: Instance eb94df28-2151-48bf-9571-ae16d23c66a6 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:20.070579 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a42418b0-dfa2-41eb-9583-26b95fd7337c tempest-AttachVolumeNegativeTest-391204334 tempest-AttachVolumeNegativeTest-391204334-project] 10.222.0.66 "GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6" status: 404 len: 111 microversion: 2.1 time: 0.029558 Jul 01 20:03:20.070579 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 512/1024] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:20 2022] GET /compute/v2.1/servers/eb94df28-2151-48bf-9571-ae16d23c66a6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:22.159205 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2042332619", "imageRef": "917404a7-b5b7-49f2-b0a1-a631cc1eaba8", "flavorRef": "452", "networks": [{"uuid": "cb46ba7b-648e-4780-990c-7464d8fd9433"}]}} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:22.211646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.network.neutron [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] validate_networks() for [('cb46ba7b-648e-4780-990c-7464d8fd9433', None, None, None, None, None)] {{(pid=124287) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 01 20:03:22.723886 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Flavor limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 01 20:03:22.724626 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Image limits 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 01 20:03:22.724748 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Flavor pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 01 20:03:22.725160 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Image pref 0:0:0 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 01 20:03:22.725564 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.virt.hardware [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 01 20:03:22.734750 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:22.735578 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:22.736373 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:22.736806 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:22.757744 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Getting quotas for project 8fc7896ac2f04a87bbe1e19b92c87fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 01 20:03:22.762718 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.quota [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Getting quotas for user 48d92050460c411997ab955ff07dc3cd and project 8fc7896ac2f04a87bbe1e19b92c87fc6. Resources: {'cores', 'ram', 'instances'} {{(pid=124287) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 01 20:03:22.777130 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Going to run 1 instances... {{(pid=124287) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 01 20:03:22.779373 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='917404a7-b5b7-49f2-b0a1-a631cc1eaba8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 01 20:03:22.836575 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-f53402ad-5bd7-4d77-a390-7a8b5e9add19 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677936 Jul 01 20:03:22.838404 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 513/1025] 10.222.0.66 () {60 vars in 1146 bytes} [Fri Jul 1 20:03:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 01 20:03:22.849010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-78aa7306-b6c3-456b-9531-6cf2d4048993 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:22.850382 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-78aa7306-b6c3-456b-9531-6cf2d4048993 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:22.926431 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-78aa7306-b6c3-456b-9531-6cf2d4048993 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:22.933816 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-78aa7306-b6c3-456b-9531-6cf2d4048993 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1219 microversion: 2.1 time: 0.089742 Jul 01 20:03:22.934396 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 513/1026] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:22 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:23.953788 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:23.954565 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:23.961165 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:23.961835 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:23.963824 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:23.964374 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:24.075928 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:24.087057 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e16ace92-d9f2-4c40-9327-10ec178fd0db tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1279 microversion: 2.1 time: 0.137887 Jul 01 20:03:24.087765 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 514/1027] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:23 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:24.505282 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-1132d66c-80fd-46b0-a71a-5e7f92156a20 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Action: 'create', calling method: .version_select at 0x7fa0077af160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1275446535", "metadata": {"Type": "work"}}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:24.835996 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-1132d66c-80fd-46b0-a71a-5e7f92156a20 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.453009 Jul 01 20:03:24.836621 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 514/1028] 10.222.0.66 () {60 vars in 1155 bytes} [Fri Jul 1 20:03:24 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 454 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 01 20:03:24.848121 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-91abc5cc-1b0d-4518-b525-2a96c01be78d tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Calling method '.version_select at 0x7fa00757b790>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:24.902473 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-91abc5cc-1b0d-4518-b525-2a96c01be78d tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6" status: 200 len: 353 microversion: 2.1 time: 0.058065 Jul 01 20:03:24.903218 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 515/1029] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:24 2022] GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:25.105085 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:25.105731 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:25.112246 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:25.112696 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:25.113471 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:25.113940 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:25.405001 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:25.412507 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e35433f0-2e42-47ee-acea-816544059e8d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1319 microversion: 2.1 time: 0.312006 Jul 01 20:03:25.413075 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 515/1030] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:25 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:25.716785 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [req-d2721d7a-702a-4668-b5b7-93733d60bece req-9ccb52ba-1f06-4ecc-ba2d-6c425cbf2cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1b69ef6-f510-4e9c-b4c2-0e380cf5be19", "tag": "b9536b26-42f3-4752-b48d-89169327f3dc"}]} {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:25.725944 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-d2721d7a-702a-4668-b5b7-93733d60bece req-9ccb52ba-1f06-4ecc-ba2d-6c425cbf2cd4 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:25.726388 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [req-d2721d7a-702a-4668-b5b7-93733d60bece req-9ccb52ba-1f06-4ecc-ba2d-6c425cbf2cd4 service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:25.737679 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.compute.server_external_events [req-d2721d7a-702a-4668-b5b7-93733d60bece req-9ccb52ba-1f06-4ecc-ba2d-6c425cbf2cd4 service nova] Creating event network-changed:b9536b26-42f3-4752-b48d-89169327f3dc for instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 on hv-cinder-84460 Jul 01 20:03:25.742562 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [req-d2721d7a-702a-4668-b5b7-93733d60bece req-9ccb52ba-1f06-4ecc-ba2d-6c425cbf2cd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030762 Jul 01 20:03:25.743321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 516/1031] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:03:25.915045 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-ac9220b3-6dc0-4403-adad-be8ab97be532 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Calling method '.version_select at 0x7fa0077da4c0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:25.964187 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-ac9220b3-6dc0-4403-adad-be8ab97be532 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6" status: 200 len: 354 microversion: 2.1 time: 0.052844 Jul 01 20:03:25.964743 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 516/1032] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:25 2022] GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:25.976273 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c9b666e5-3689-421d-9136-c2dda3040c24 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Calling method '.version_select at 0x7fa0074a7160>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:26.023510 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c9b666e5-3689-421d-9136-c2dda3040c24 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6" status: 200 len: 354 microversion: 2.1 time: 0.051345 Jul 01 20:03:26.024156 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 517/1033] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:25 2022] GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:26.036063 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-15120b4a-ea66-43e2-9ac2-1af17b3b2e20 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Calling method '.version_select at 0x7fa007769f70>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:26.097277 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-15120b4a-ea66-43e2-9ac2-1af17b3b2e20 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6" status: 202 len: 0 microversion: 2.1 time: 0.064935 Jul 01 20:03:26.098008 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 517/1034] 10.222.0.66 () {58 vars in 1247 bytes} [Fri Jul 1 20:03:26 2022] DELETE /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:03:26.106563 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3120900c-ec53-4771-b328-b3fa52581662 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Calling method '.version_select at 0x7fa0075fd9d0>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:26.158356 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3120900c-ec53-4771-b328-b3fa52581662 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6" status: 200 len: 353 microversion: 2.1 time: 0.056039 Jul 01 20:03:26.158994 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 518/1035] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:26 2022] GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:26.431340 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:26.431915 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:26.438634 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:26.439081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:26.439839 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:26.440272 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:26.573694 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:26.581210 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a6dbaaa1-9251-4052-ae2c-347468b9a6cc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1319 microversion: 2.1 time: 0.154434 Jul 01 20:03:26.581820 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 518/1036] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:26 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:27.172270 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-162a4e5f-c5f7-4705-a53b-bc49750f8d34 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Calling method '.version_select at 0x7fa0076490d0>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:27.203209 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.wsgi [None req-162a4e5f-c5f7-4705-a53b-bc49750f8d34 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] HTTP exception thrown: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-162a4e5f-c5f7-4705-a53b-bc49750f8d34 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Request method failure captured: Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: request: GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 HTTP/1.1 Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept: application/json Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Accept-Encoding: identity Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Connection: close Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Length: 0 Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Content-Type: application/json Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Host: 10.222.0.66 Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Openstack-System-Scope: None Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: User-Agent: python-urllib3/1.26.9 Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Auth-Token: gAAAAABiv1MM9yF-vGeKm77b0yu4WIqH-VpSXIhKu5kem8FhOueTbjk-CK0J1T5eyjt6IKOmsXgKDbv5UQK7J1Q5PqfEp2acHXyhhOwMrTS1gZfUEIZCpljkyP57M-gBssdYkLpMidzGm6HhtfYXN-aFFa_DhT8nt51TPAtm6DBRdo3pVlELKRI Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Id: None Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Domain-Name: None Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Identity-Status: Confirmed Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Is-Admin-Project: True Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Id: default Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Domain-Name: Default Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Id: 5b13ed2b118641f286de3f0c3696bcb1 Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Project-Name: tempest-VolumesGetTestJSON-414096211 Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Role: reader,member Jul 01 20:03:27.205499 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Roles: reader,member Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_5b13ed2b118641f286de3f0c3696bcb1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/5b13ed2b118641f286de3f0c3696bcb1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5b13ed2b118641f286de3f0c3696bcb1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/5b13ed2b118641f286de3f0c3696bcb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant: tempest-VolumesGetTestJSON-414096211 Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Id: 5b13ed2b118641f286de3f0c3696bcb1 Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-Tenant-Name: tempest-VolumesGetTestJSON-414096211 Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User: tempest-VolumesGetTestJSON-414096211-project Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Id: default Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Domain-Name: Default Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Id: 31a2f17f0fd14bf88e481af0575940f8 Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: X-User-Name: tempest-VolumesGetTestJSON-414096211-project Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: method: Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: exception: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: action_args: {'id': '0911aa20-40a6-4b2f-ac97-fd74b4147dc6'} Jul 01 20:03:27.207133 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. (HTTP 404) (Request-ID: req-b0279e30-e1cb-4188-84c3-830ebee8414f) Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:27.208153 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 01 20:03:27.209641 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 01 20:03:27.211123 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. Jul 01 20:03:27.212584 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: ERROR nova.api.openstack.wsgi Jul 01 20:03:27.214321 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-162a4e5f-c5f7-4705-a53b-bc49750f8d34 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] Returning 404 to user: Volume 0911aa20-40a6-4b2f-ac97-fd74b4147dc6 could not be found. {{(pid=124287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:03:27.215355 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-162a4e5f-c5f7-4705-a53b-bc49750f8d34 tempest-VolumesGetTestJSON-414096211 tempest-VolumesGetTestJSON-414096211-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6" status: 404 len: 109 microversion: 2.1 time: 0.047938 Jul 01 20:03:27.219422 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 519/1037] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:27 2022] GET /compute/v2.1/os-volumes/0911aa20-40a6-4b2f-ac97-fd74b4147dc6 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:03:27.597986 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:27.598603 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:27.606117 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:27.606569 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:27.607342 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:27.607782 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:27.747631 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:27.755705 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-facdfe74-623a-467f-9812-bb580ed8c50a tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1319 microversion: 2.1 time: 0.161601 Jul 01 20:03:27.757910 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 519/1038] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:27 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:28.773313 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:28.774251 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:28.781936 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:28.782393 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:28.783169 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:28.783607 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:28.931798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:28.941015 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-7950191d-92d8-449b-b1bc-b6820be699ea tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1319 microversion: 2.1 time: 0.172640 Jul 01 20:03:28.943178 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 520/1039] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:28 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:29.949447 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-fdf35e1c-6dd3-4a9f-b4fe-735ce8176a34 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa0074604c0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:29.958493 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:29.959114 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:29.966315 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:29.966766 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:29.967534 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:29.967968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:29.997243 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-fdf35e1c-6dd3-4a9f-b4fe-735ce8176a34 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/9f8d4f17-69f8-45ab-ab5e-fc59f5b6aaac" status: 200 len: 351 microversion: 2.1 time: 0.052142 Jul 01 20:03:29.997943 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 520/1040] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:29 2022] GET /compute/v2.1/os-volumes/9f8d4f17-69f8-45ab-ab5e-fc59f5b6aaac => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:30.102050 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:30.109917 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3c8bbb9a-533b-456a-9e63-5c63ebb41e57 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1319 microversion: 2.1 time: 0.155209 Jul 01 20:03:30.110485 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 521/1041] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:29 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 01 20:03:30.673841 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-5a2d8fb1-c7fc-453d-8f46-0e0300f3d5d9 req-af0812a2-3685-4512-aa83-0d33404c209c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b69ef6-f510-4e9c-b4c2-0e380cf5be19", "name": "network-vif-plugged", "status": "completed", "tag": "b9536b26-42f3-4752-b48d-89169327f3dc"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:30.684088 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-5a2d8fb1-c7fc-453d-8f46-0e0300f3d5d9 req-af0812a2-3685-4512-aa83-0d33404c209c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:30.684537 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-5a2d8fb1-c7fc-453d-8f46-0e0300f3d5d9 req-af0812a2-3685-4512-aa83-0d33404c209c service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:30.694592 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-5a2d8fb1-c7fc-453d-8f46-0e0300f3d5d9 req-af0812a2-3685-4512-aa83-0d33404c209c service nova] Creating event network-vif-plugged:b9536b26-42f3-4752-b48d-89169327f3dc for instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 on hv-cinder-84460 Jul 01 20:03:30.700086 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-5a2d8fb1-c7fc-453d-8f46-0e0300f3d5d9 req-af0812a2-3685-4512-aa83-0d33404c209c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149156 Jul 01 20:03:30.700719 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 521/1042] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:31.127257 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:31.127877 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:31.135005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:31.135566 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:31.136334 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:31.136773 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:31.269432 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:31.277623 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-e9ac48fe-e0d9-4a60-914a-9673a197059c tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1319 microversion: 2.1 time: 0.154283 Jul 01 20:03:31.278227 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 522/1043] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:31 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:31.320577 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-35f7ed66-eca0-485d-bd77-8b605c12ad0e tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa0076e04c0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:31.367535 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-35f7ed66-eca0-485d-bd77-8b605c12ad0e tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/bfb6765b-6397-4bf6-b587-a6e36373a74d" status: 200 len: 349 microversion: 2.1 time: 0.052475 Jul 01 20:03:31.368096 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 522/1044] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:31 2022] GET /compute/v2.1/os-volumes/bfb6765b-6397-4bf6-b587-a6e36373a74d => generated 349 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:32.293968 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:32.294589 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:32.301033 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:32.301476 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:32.302265 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:32.302700 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:32.430075 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:32.437868 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-d9256e04-c2fc-4087-b430-f1a0b7c3dcde tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1508 microversion: 2.1 time: 0.147706 Jul 01 20:03:32.438432 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 523/1045] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:32 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:32.454945 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd723b65-fe37-4f95-900c-a61b1b1cac5e", "device": "/dev/sdb"}} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:03:32.456148 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:32.463896 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:32.464370 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:32.465133 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:32.465567 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:32.690416 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-3601c364-b314-4950-8539-78eadc59c78d tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa00746e700>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:32.718626 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-882d2f28-e293-4ecc-842f-bceaada2c259 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "POST /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267746 Jul 01 20:03:32.719382 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 523/1046] 10.222.0.66 () {60 vars in 1322 bytes} [Fri Jul 1 20:03:32 2022] POST /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:32.746196 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-3601c364-b314-4950-8539-78eadc59c78d tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6a1562f8-eb1d-4d5b-89b0-a1e6374fb85c" status: 200 len: 350 microversion: 2.1 time: 0.059500 Jul 01 20:03:32.746879 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 524/1047] 10.222.0.66 () {58 vars in 1244 bytes} [Fri Jul 1 20:03:32 2022] GET /compute/v2.1/os-volumes/6a1562f8-eb1d-4d5b-89b0-a1e6374fb85c => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 01 20:03:32.763196 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-e122483a-5aba-4f22-838d-1b953883ffbf tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa00c1f9f70>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:32.849199 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-e122483a-5aba-4f22-838d-1b953883ffbf tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.090796 Jul 01 20:03:32.849927 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 524/1048] 10.222.0.66 () {58 vars in 1133 bytes} [Fri Jul 1 20:03:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:32.859395 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=2 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:32.860274 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell0:SELECT=6 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:32.864252 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-bfabc358-d6d9-4ec3-8505-4a44b192aff5 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa007649670>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:32.945466 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-bfabc358-d6d9-4ec3-8505-4a44b192aff5 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.086742 Jul 01 20:03:32.946116 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 525/1049] 10.222.0.66 () {58 vars in 1148 bytes} [Fri Jul 1 20:03:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:32.956108 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell0:SELECT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:32.960159 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-d1eceaee-195a-4312-bdd2-124da224d861 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa007624160>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:33.042880 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-d1eceaee-195a-4312-bdd2-124da224d861 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.088098 Jul 01 20:03:33.043457 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 525/1050] 10.222.0.66 () {58 vars in 1133 bytes} [Fri Jul 1 20:03:32 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:33.055031 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-17f3a17f-553f-4f1f-acce-ccfe65de9e34 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa0076e7940>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:33.142959 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-17f3a17f-553f-4f1f-acce-ccfe65de9e34 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.091773 Jul 01 20:03:33.143795 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 526/1051] 10.222.0.66 () {58 vars in 1166 bytes} [Fri Jul 1 20:03:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:33.155866 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-a7eaabca-6233-4321-96c3-b29bc7972472 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa00745ba60>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:33.235791 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-a7eaabca-6233-4321-96c3-b29bc7972472 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.083714 Jul 01 20:03:33.236891 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 526/1052] 10.222.0.66 () {58 vars in 1169 bytes} [Fri Jul 1 20:03:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:33.248749 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2f3f60c6-5fe1-4baa-85f0-627b77b2ed10 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa00cafaaf0>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:33.332530 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2f3f60c6-5fe1-4baa-85f0-627b77b2ed10 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.087512 Jul 01 20:03:33.333143 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 527/1053] 10.222.0.66 () {58 vars in 1154 bytes} [Fri Jul 1 20:03:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:33.344298 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-5473ce7f-fc82-47db-ae95-0e4a42a4cbb9 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa00c153af0>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:33.424815 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-5473ce7f-fc82-47db-ae95-0e4a42a4cbb9 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.084246 Jul 01 20:03:33.425511 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 527/1054] 10.222.0.66 () {58 vars in 1187 bytes} [Fri Jul 1 20:03:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:03:33.438573 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-2531e924-2098-43da-adf2-e29f792a8034 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] Calling method '.version_select at 0x7fa007649a60>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:33.518307 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-2531e924-2098-43da-adf2-e29f792a8034 tempest-VolumesTestJSON-1434299295 tempest-VolumesTestJSON-1434299295-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.084561 Jul 01 20:03:33.519142 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 528/1055] 10.222.0.66 () {58 vars in 1154 bytes} [Fri Jul 1 20:03:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:52.063818 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:52.064584 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG dbcounter [-] [124286] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124286) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:52.068611 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:52.069212 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:52.079036 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:52.079474 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:52.080260 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:52.080685 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:52.160062 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.objects.instance [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lazy-loading 'services' on Instance uuid f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 {{(pid=124286) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:03:52.231549 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-3b86b686-bd5a-49e7-9d30-e6e0c4ad60d5 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19/os-volume_attachments/fd723b65-fe37-4f95-900c-a61b1b1cac5e" status: 202 len: 0 microversion: 2.1 time: 0.167623 Jul 01 20:03:52.232127 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 528/1056] 10.222.0.66 () {58 vars in 1415 bytes} [Fri Jul 1 20:03:52 2022] DELETE /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19/os-volume_attachments/fd723b65-fe37-4f95-900c-a61b1b1cac5e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 01 20:03:56.494843 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:56.495610 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG dbcounter [-] [124287] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124287) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 01 20:03:56.500881 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:56.501604 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:56.512330 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:56.513039 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:56.513842 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:56.514284 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:56.539484 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Going to try to terminate instance {{(pid=124287) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 01 20:03:56.618092 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-49caa850-921d-4a19-9796-d1f8c2a839ae tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 204 len: 0 microversion: 2.1 time: 0.124285 Jul 01 20:03:56.619002 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 529/1057] 10.222.0.66 () {58 vars in 1238 bytes} [Fri Jul 1 20:03:56 2022] DELETE /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 01 20:03:56.628877 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:56.629607 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:56.635872 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:56.636319 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:56.637697 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:56.638130 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:56.765343 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:56.773155 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-9cfc7591-a25a-4a63-acc6-57cb53234c97 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1514 microversion: 2.1 time: 0.149022 Jul 01 20:03:56.773757 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 529/1058] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:56 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:57.790157 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:57.790780 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:57.797345 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:57.797822 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:57.798578 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:57.799009 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:57.931770 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:57.939673 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-b30fa7e7-f14f-4c6d-9359-852415cd77ee tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1514 microversion: 2.1 time: 0.153885 Jul 01 20:03:57.940235 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 530/1059] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:57 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:03:58.956505 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:03:58.957106 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:03:58.963613 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:58.964081 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:58.965388 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:03:58.965853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:03:59.095173 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.policy [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124286) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:03:59.102724 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-b9315d6c-edca-4eb6-a3d9-0c8fe1b7fd1d tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1514 microversion: 2.1 time: 0.150118 Jul 01 20:03:59.103358 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 530/1060] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:03:58 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:04:00.120262 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:04:00.120933 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:04:00.128646 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:00.129937 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:00.130974 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:00.131745 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:00.272005 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:04:00.281032 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-c9d67ce5-7b5d-4a80-945d-73657d858616 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1514 microversion: 2.1 time: 0.164482 Jul 01 20:04:00.281536 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 531/1061] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:04:00 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:04:01.106923 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [req-93672821-8aec-44f5-aa92-55174516420d req-35203f86-2c56-41c5-bd4f-9fe2ced8d93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1b69ef6-f510-4e9c-b4c2-0e380cf5be19", "name": "network-vif-deleted", "tag": "b9536b26-42f3-4752-b48d-89169327f3dc"}]} {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 01 20:04:01.114956 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-93672821-8aec-44f5-aa92-55174516420d req-35203f86-2c56-41c5-bd4f-9fe2ced8d93d service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:01.115403 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [req-93672821-8aec-44f5-aa92-55174516420d req-35203f86-2c56-41c5-bd4f-9fe2ced8d93d service nova] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:01.128344 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.compute.server_external_events [req-93672821-8aec-44f5-aa92-55174516420d req-35203f86-2c56-41c5-bd4f-9fe2ced8d93d service nova] Creating event network-vif-deleted:b9536b26-42f3-4752-b48d-89169327f3dc for instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 on hv-cinder-84460 Jul 01 20:04:01.133208 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [req-93672821-8aec-44f5-aa92-55174516420d req-35203f86-2c56-41c5-bd4f-9fe2ced8d93d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.170723 Jul 01 20:04:01.133814 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 531/1062] 10.222.0.66 () {64 vars in 1317 bytes} [Fri Jul 1 20:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 01 20:04:01.297779 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.api.openstack.wsgi [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:04:01.298394 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.compute.api [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124287) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:04:01.305671 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:01.306126 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:01.306895 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:01.307333 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:01.342911 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:01.343369 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG oslo_concurrency.lockutils [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:01.343827 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.objects.instance [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lazy-loading 'fault' on Instance uuid f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 {{(pid=124287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 01 20:04:01.385094 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: DEBUG nova.policy [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d92050460c411997ab955ff07dc3cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8fc7896ac2f04a87bbe1e19b92c87fc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124287) authorize /opt/stack/nova/nova/policy.py:199}} Jul 01 20:04:01.393320 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO nova.api.openstack.requestlog [None req-455b61a2-5bce-496a-aec6-4ce13f904efc tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 200 len: 1309 microversion: 2.1 time: 0.099421 Jul 01 20:04:01.394036 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: [pid: 124287|app: 0|req: 532/1063] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:04:01 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 01 20:04:02.413010 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Calling method '>' {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 01 20:04:02.413738 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.compute.api [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] [instance: f1b69ef6-f510-4e9c-b4c2-0e380cf5be19] Fetching instance by UUID {{(pid=124286) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 01 20:04:02.423406 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:02.423853 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:02.424634 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 01 20:04:02.425073 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG oslo_concurrency.lockutils [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Lock "bc420076-a5c0-4107-825e-ec6145e40494" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124286) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 01 20:04:02.439793 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.wsgi [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] HTTP exception thrown: Instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 could not be found. Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Request method failure captured: Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: request: GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 HTTP/1.1 Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept: application/json Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Accept-Encoding: identity Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Connection: close Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Length: 0 Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Content-Type: application/json Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Host: 10.222.0.66 Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Openstack-System-Scope: None Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: User-Agent: python-urllib3/1.26.9 Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Auth-Token: gAAAAABiv1K-Oez4MpboqUsmJs86oKqq5wgWcgMZdxvzPNqf_tojSaNn2IUDpAx_uaCwFmSEkF_1UpvhpsykT2YddVLDRILzLMTqT7r6IrqSTkfM5qkVzKIjLu_JxRrEKl2Do214v3KERLnOla1ZzQW68_PfXQwtKxV0IV4IUGDuzZHAjJvY55g Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Id: None Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Domain-Name: None Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Identity-Status: Confirmed Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Is-Admin-Project: True Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Id: default Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Domain-Name: Default Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Id: 8fc7896ac2f04a87bbe1e19b92c87fc6 Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1135969710 Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Role: reader,member Jul 01 20:04:02.441674 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Roles: reader,member Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8fc7896ac2f04a87bbe1e19b92c87fc6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}] Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant: tempest-VolumesSnapshotTestJSON-1135969710 Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Id: 8fc7896ac2f04a87bbe1e19b92c87fc6 Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1135969710 Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User: tempest-VolumesSnapshotTestJSON-1135969710-project Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Id: default Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Domain-Name: Default Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Id: 48d92050460c411997ab955ff07dc3cd Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: X-User-Name: tempest-VolumesSnapshotTestJSON-1135969710-project Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: method: > Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: exception: Instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 could not be found. Jul 01 20:04:02.443374 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: action_args: {'id': 'f1b69ef6-f510-4e9c-b4c2-0e380cf5be19'} Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: {{(pid=124286) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 could not be found. Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 01 20:04:02.444318 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 could not be found. Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 could not be found. Jul 01 20:04:02.445919 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: ERROR nova.api.openstack.wsgi Jul 01 20:04:02.447351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: DEBUG nova.api.openstack.wsgi [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] Returning 404 to user: Instance f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 could not be found. {{(pid=124286) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 01 20:04:02.447351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO nova.api.openstack.requestlog [None req-c36aae64-6d38-4e44-ba24-a6340603b421 tempest-VolumesSnapshotTestJSON-1135969710 tempest-VolumesSnapshotTestJSON-1135969710-project] 10.222.0.66 "GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19" status: 404 len: 111 microversion: 2.1 time: 0.034954 Jul 01 20:04:02.447351 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: [pid: 124286|app: 0|req: 532/1064] 10.222.0.66 () {58 vars in 1235 bytes} [Fri Jul 1 20:04:02 2022] GET /compute/v2.1/servers/f1b69ef6-f510-4e9c-b4c2-0e380cf5be19 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 01 20:06:13.467798 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:06:13.468311 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Fri Jul 1 20:06:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:06:17.952848 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:06:17.953422 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Fri Jul 1 20:06:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:06:19.045605 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:06:19.046232 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Fri Jul 1 20:06:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:06:23.892920 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:06:23.893496 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Fri Jul 1 20:06:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:06:38.760390 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:06:38.761023 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Fri Jul 1 20:06:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:06:40.999154 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:06:40.999780 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Fri Jul 1 20:06:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:09:33.476346 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:09:33.476973 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Fri Jul 1 20:09:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:09:37.961595 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:09:37.962069 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Fri Jul 1 20:09:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:09:39.053642 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:09:39.054311 dv-cinder-844601-7-iscsi devstack@n-api.service[124286]: Fri Jul 1 20:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 01 20:09:43.902202 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 01 20:09:43.902843 dv-cinder-844601-7-iscsi devstack@n-api.service[124287]: Fri Jul 1 20:09:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!